Aug 12 16:13:52 devstack cinder-volume[83380]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Aug 12 16:13:52 devstack cinder-volume[83380]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 12 16:13:52 devstack cinder-volume[83380]: we strongly recommend against using it for new projects.
Aug 12 16:13:52 devstack cinder-volume[83380]: If you are already using Eventlet, we recommend migrating to a different
Aug 12 16:13:52 devstack cinder-volume[83380]: framework.  For more detail see
Aug 12 16:13:52 devstack cinder-volume[83380]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 12 16:13:52 devstack cinder-volume[83380]:   import eventlet  # noqa
Aug 12 16:13:54 devstack cinder-volume[83380]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83380) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 12 16:13:54 devstack cinder-volume[83380]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83380) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 12 16:13:54 devstack cinder-volume[83380]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83380) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 12 16:13:55 devstack cinder-volume[83380]: INFO dbcounter [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Registered counter for database cinder
Aug 12 16:13:55 devstack cinder-volume[83380]: DEBUG oslo_db.sqlalchemy.engines [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 12 16:13:56 devstack cinder-volume[83380]: DEBUG dbcounter [-] [83380] Writer thread running {{(pid=83380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 12 16:13:56 devstack cinder-volume[83380]: INFO cinder.rpc [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Aug 12 16:13:56 devstack cinder-volume[83380]: INFO cinder.rpc [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Aug 12 16:13:56 devstack cinder-volume[83380]: DEBUG oslo_db.sqlalchemy.engines [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 12 16:13:56 devstack cinder-volume[83380]: INFO cinder.volume.manager [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Determined volume DB was empty at startup.
Aug 12 16:13:56 devstack cinder-volume[83380]: DEBUG cinder.volume.manager [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83380) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Aug 12 16:13:56 devstack cinder-volume[83380]: INFO cinder.volume.manager [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Service not found for updating active_backend_id, assuming default for driver init.
Aug 12 16:13:56 devstack cinder-volume[83380]: WARNING stevedore.named [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 12 16:13:56 devstack cinder-volume[83380]: WARNING castellan.key_manager [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 12 16:13:56 devstack cinder-volume[83380]: WARNING cinder.keymgr.conf_key_mgr [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 12 16:13:56 devstack cinder-volume[83380]: DEBUG cinder.volume.drivers.lvm [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=83380) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Aug 12 16:13:56 devstack cinder-volume[83380]: DEBUG oslo_concurrency.processutils [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=83380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:13:56 devstack cinder-volume[83380]: DEBUG oslo_concurrency.processutils [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] CMD "cinder-rtstool verify" returned: 0 in 0.421s {{(pid=83380) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:13:56 devstack cinder-volume[83380]: DEBUG oslo_db.sqlalchemy.engines [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 12 16:13:56 devstack cinder-volume[83380]: INFO cinder.rpc [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Aug 12 16:13:56 devstack cinder-volume[83380]: INFO cinder.rpc [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Aug 12 16:13:56 devstack cinder-volume[83380]: WARNING stevedore.named [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 12 16:13:56 devstack cinder-volume[83380]: WARNING castellan.key_manager [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 12 16:13:56 devstack cinder-volume[83380]: INFO cinder.volume.manager [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_db.sqlalchemy.engines [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83380) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 12 16:13:57 devstack cinder-volume[83380]: INFO oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Starting 1 workers
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Started child 83532 {{(pid=83380) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Full set of CONF: {{(pid=83380) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] ******************************************************************************** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Configuration options gathered from: {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] ================================================================================ {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] allow_availability_zone_fallback = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] allow_compression_on_image_upload = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] allowed_direct_url_schemes     = [] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] api_rate_limit                 = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] auth_strategy                  = keystone {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] az_cache_duration              = 3600 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_availability_zone      = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_host                   = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_name                   = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_stats_polling_interval = 60 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backup_api_class               = cinder.backup.api.API {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backup_name_template           = backup-%s {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backup_use_same_host           = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backup_use_temp_snapshot       = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] chap_password                  = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] chap_username                  =  {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cinder_internal_tenant_project_id = 19d6a7f8343e4ad58925252ca12fdd31 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83532]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cinder_internal_tenant_user_id = 3b62e6b455b14b0ca66a633e3e1d366c {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cloned_volume_same_az          = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cluster                        = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] compression_format             = gzip {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] compute_api_class              = cinder.compute.nova.API {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] config_dir                     = [] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] config_source                  = [] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] control_exchange               = openstack {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] debug                          = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] default_availability_zone      = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] default_group_type             = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] default_volume_type            = lvmdriver-1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] disk_geometry                  = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] driver_client_cert             = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] driver_client_cert_key         = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] driver_data_namespace          = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] driver_ssl_cert_path           = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] driver_ssl_cert_verify         = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] driver_use_ssl                 = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] enable_force_upload            = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] enable_new_services            = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] enable_unsupported_driver      = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] enabled_backends               = ['lvmdriver-1'] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] enforce_multipath_for_image_xfer = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] filter_function                = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance_api_insecure            = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance_api_servers             = ['http://192.168.122.135/image'] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance_api_ssl_compression     = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance_ca_certificates_file    = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance_catalog_info            = image:glance:publicURL {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance_certfile                = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance_keyfile                 = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance_num_retries             = 3 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance_request_timeout         = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] goodness_function              = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] graceful_shutdown_timeout      = 5 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] group_api_class                = cinder.group.api.API {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] host                           = devstack {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] image_compress_on_upload       = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] image_conversion_address_space_limit = 1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] image_conversion_cpu_limit     = 60 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] image_conversion_disable       = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] image_upload_use_cinder_backend = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] image_upload_use_internal_tenant = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] image_volume_cache_enabled     = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] image_volume_cache_max_count   = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] image_volume_cache_max_size_gb = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] init_host_max_objects_retrieval = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] instance_format                = [instance: %(uuid)s]  {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] iscsi_target_flags             =  {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] iscsi_write_cache              = on {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] iser_helper                    = tgtadm {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] iser_ip_address                = 192.168.122.135 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] iser_port                      = 3260 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] log_color                      = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] log_config_append              = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] log_dir                        = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] log_file                       = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] log_options                    = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] log_rotate_interval            = 1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] log_rotate_interval_type       = days {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] log_rotation_type              = none {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] max_age                        = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] max_logfile_count              = 30 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] max_logfile_size_mb            = 200 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] max_over_subscription_ratio    = 20.0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] message_reap_interval          = 86400 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] message_ttl                    = 2592000 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] migration_create_volume_timeout_secs = 300 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] monkey_patch                   = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] monkey_patch_modules           = [] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] my_ip                          = 192.168.122.135 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] no_snapshot_gb_quota           = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] num_iser_scan_tries            = 3 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] num_shell_tries                = 3 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] num_volume_device_scan_tries   = 3 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] nvmeof_conn_info_version       = 1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] nvmet_ns_id                    = 10 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] nvmet_port_id                  = 1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] osapi_max_limit                = 1000 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] osapi_volume_ext_list          = [] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] osapi_volume_listen_port       = 8776 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] osapi_volume_use_ssl           = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] osapi_volume_workers           = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] per_volume_size_limit          = -1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] periodic_fuzzy_delay           = 60 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] periodic_interval              = 60 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] public_endpoint                = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] publish_errors                 = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] quota_backup_gigabytes         = 1000 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] quota_backups                  = 10 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] quota_gigabytes                = 1000 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] quota_groups                   = 10 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] quota_snapshots                = 10 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] quota_volumes                  = 10 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] rate_limit_burst               = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] rate_limit_except_level        = CRITICAL {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] rate_limit_interval            = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] reinit_driver_count            = 3 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] replication_device             = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] report_discard_supported       = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] report_interval                = 120 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] reservation_clean_interval     = 86400 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] reservation_expire             = 86400 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] reserved_image_namespaces      = [] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] reserved_percentage            = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] rpc_response_timeout           = 120 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] run_external_periodic_tasks    = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] scst_target_driver             = iscsi {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] scst_target_iqn_name           = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] service_down_time              = 720 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] shell_completion               = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] snapshot_name_template         = snapshot-%s {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] snapshot_same_host             = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] split_loggers                  = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] state_path                     = /opt/stack/data/cinder {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] storage_availability_zone      = nova {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] storage_protocol               = iSCSI {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] syslog_log_facility            = LOG_USER {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] target_helper                  = lioadm {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] target_ip_address              = 192.168.122.135 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] target_port                    = 3260 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] target_protocol                = iscsi {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] target_secondary_ip_addresses  = [] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] trace_flags                    = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] transport_url                  = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] until_refresh                  = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] use_chap_auth                  = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] use_default_quota_class        = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] use_journal                    = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] use_json                       = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] use_multipath_for_image_xfer   = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] use_stderr                     = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] use_syslog                     = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] verify_glance_signatures       = enabled {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] volume_api_class               = cinder.volume.api.API {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] volume_backend_name            = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] volume_clear                   = zero {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] volume_clear_ionice            = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] volume_clear_size              = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] volume_copy_bps_limit          = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] volume_dd_blocksize            = 1M {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] volume_name_template           = volume-%s {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] volume_service_inithost_offload = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] volume_usage_audit_period      = month {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] zoning_mode                    = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_concurrency.disable_process_locking = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.auth_section = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.auth_type   = password {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.auth_version = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.cache       = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.certfile    = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.delay_auth_decision = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.http_connect_timeout = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.include_service_catalog = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.insecure    = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.interface   = public {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.keyfile     = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.memcache_password =  {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.memcache_username =  {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.region_name = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.service_token_roles_required = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.service_type = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.token_cache_time = 300 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83532]: INFO cinder.volume.manager [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.backend                  = dogpile.cache.null {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.backend_argument         = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.backend_expiration_time  = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.config_prefix            = cache.oslo {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.debug_cache_backend      = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.enable_retry_client      = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.enable_socket_keepalive  = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.enabled                  = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.expiration_time          = 600 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.hashclient_retry_attempts = 2 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.memcache_dead_retry      = 300 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.memcache_pool_maxsize    = 10 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.memcache_sasl_enabled    = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.password                 = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.proxies                  = [] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.redis_db                 = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.redis_sentinel_service_name = mymaster {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.redis_server             = localhost:6379 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.retry_attempts           = 2 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.retry_delay              = 0.0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.socket_keepalive_count   = 1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.socket_keepalive_idle    = 1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.socket_keepalive_interval = 1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.socket_timeout           = 1.0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.tls_allowed_ciphers      = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.tls_cafile               = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.tls_certfile             = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.tls_enabled              = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.tls_keyfile              = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cache.username                 = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] coordination.backend_url       = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.asyncio_connection    = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.asyncio_slave_connection = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.backend               = sqlalchemy {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.connection            = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.connection_debug      = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.connection_parameters =  {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.connection_recycle_time = 3600 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.connection_trace      = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.db_inc_retry_interval = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.db_max_retries        = 20 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.db_max_retry_interval = 10 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.db_retry_interval     = 1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.max_overflow          = 50 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.max_pool_size         = 5 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.max_retries           = 10 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.mysql_wsrep_sync_wait = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.pool_timeout          = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.retry_interval        = 10 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.slave_connection      = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.sqlite_synchronous    = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.synchronous_reader    = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] database.use_db_reconnect      = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] profiler.connection_string     = messaging:// {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] profiler.enabled               = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] profiler.es_doc_type           = notification {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] profiler.es_scroll_size        = 10000 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] profiler.es_scroll_time        = 2m {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] profiler.filter_error_trace    = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] profiler.hmac_keys             = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] profiler.sentinel_service_name = mymaster {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] profiler.socket_timeout        = 0.1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] profiler.trace_requests        = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] profiler.trace_sqlalchemy      = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] profiler_jaeger.process_tags   = {} {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] profiler_jaeger.service_name_prefix = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] profiler_otlp.service_name_prefix = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_policy.enforce_new_defaults = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_policy.policy_default_rule = default {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_policy.policy_file        = policy.yaml {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] privsep_osbrick.group          = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] privsep_osbrick.helper_command = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] privsep_osbrick.user           = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cinder_sys_admin.group         = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cinder_sys_admin.helper_command = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] cinder_sys_admin.user          = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] service_user.auth_section      = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] service_user.auth_type         = password {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] service_user.cafile            = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] service_user.certfile          = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] service_user.collect_timing    = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] service_user.insecure          = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] service_user.keyfile           = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] service_user.send_service_user_token = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] service_user.split_loggers     = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] service_user.timeout           = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:13:57 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance.auth_section            = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance.auth_type               = password {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance.certfile                = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance.collect_timing          = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance.insecure                = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance.keyfile                 = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance.region_name             = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance.split_loggers           = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] glance.timeout                 = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.backend_availability_zone = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.chap_password = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.chap_username =  {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.disk_geometry = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.driver_client_cert = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.driver_client_cert_key = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.driver_data_namespace = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.driver_use_ssl = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.enable_unsupported_driver = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.extra_capabilities = {} {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.filter_function = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.goodness_function = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.iscsi_target_flags =  {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.iscsi_write_cache = on {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.iser_helper   = tgtadm {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.iser_port     = 3260 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.lvm_mirrors   = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.lvm_share_target = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.lvm_type      = auto {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.num_shell_tries = 3 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.nvmet_port_id = 1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.replication_device = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.report_discard_supported = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.reserved_percentage = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.scst_target_driver = iscsi {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.scst_target_iqn_name = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.storage_protocol = iSCSI {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.target_helper = tgtadm {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.target_port   = 3260 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.target_protocol = iscsi {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.trace_flags   = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.unique_fqdn_network = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.use_chap_auth = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.volume_backend_name = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.volume_clear  = zero {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.volume_clear_ionice = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.volume_clear_size = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.volume_group  = cinder-volumes {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_reports.file_event_handler = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_reports.log_dir           = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.backend_availability_zone = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.backend_host       = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.chap_password      = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.chap_username      = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.chiscsi_conf       = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.disk_geometry      = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.driver_client_cert = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.driver_client_cert_key = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.driver_data_namespace = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.driver_use_ssl     = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.extra_capabilities = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.filter_function    = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.goodness_function  = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.iscsi_target_flags = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.iser_helper        = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.iser_ip_address    = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.iser_port          = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.iser_target_prefix = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.lvm_conf_file      = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.lvm_mirrors        = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.lvm_share_target   = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.lvm_type           = auto {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.num_shell_tries    = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.nvmet_port_id      = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.replication_device = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.report_discard_supported = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.reserved_percentage = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.scst_target_driver = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.storage_protocol   = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.target_helper      = lioadm {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.target_ip_address  = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.target_port        = 3260 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.target_protocol    = iscsi {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.trace_flags        = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.unique_fqdn_network = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.use_chap_auth      = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.volume_clear       = zero {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.volume_clear_ionice = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.volume_clear_size  = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] lvmdriver-1.volumes_dir        = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack sudo[83537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack sudo[83537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.ssl      = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_notifications.driver = [] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_notifications.retry = -1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] oslo_messaging_notifications.transport_url = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] key_manager.fixed_key          = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican.barbican_api_version  = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican.barbican_endpoint     = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican.barbican_endpoint_type = public {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican.barbican_region_name  = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican.cafile                = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican.certfile              = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican.collect_timing        = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican.insecure              = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican.keyfile               = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican.number_of_retries     = 60 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican.retry_delay           = 1 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican.send_service_user_token = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican.split_loggers         = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican.timeout               = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican.verify_ssl            = True {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican.verify_ssl_path       = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican_service_user.auth_section = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican_service_user.auth_type = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican_service_user.cafile   = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican_service_user.certfile = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican_service_user.collect_timing = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican_service_user.insecure = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican_service_user.keyfile  = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican_service_user.split_loggers = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] barbican_service_user.timeout  = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] vault.approle_role_id          = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] vault.approle_secret_id        = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] vault.auth_method              = approle {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] vault.auth_path                = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] vault.kv_mountpoint            = secret {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] vault.kv_path                  = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] vault.kv_version               = 2 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] vault.namespace                = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] vault.root_token_id            = **** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] vault.ssl_ca_crt_file          = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] vault.timeout                  = 60.0 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] vault.token_file               = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] vault.token_role               = None {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] vault.use_ssl                  = False {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:13:57 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] ******************************************************************************** {{(pid=83380) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}}
Aug 12 16:13:57 devstack sudo[83537]: pam_unix(sudo:session): session closed for user root
Aug 12 16:13:57 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:13:57 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:13:57 devstack sudo[83541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 12 16:13:57 devstack sudo[83541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:13:57 devstack sudo[83541]: pam_unix(sudo:session): session closed for user root
Aug 12 16:13:57 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.334s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:13:57 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:13:57 devstack cinder-volume[83532]: INFO cinder.brick.local_dev.lvm [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Aug 12 16:13:57 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:13:57 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:13:57 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:13:58 devstack sudo[83630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 12 16:13:58 devstack sudo[83630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:13:58 devstack sudo[83630]: pam_unix(sudo:session): session closed for user root
Aug 12 16:13:58 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:13:58 devstack cinder-volume[83532]: DEBUG cinder.brick.local_dev.lvm [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=83532) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Aug 12 16:13:58 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:13:58 devstack sudo[83734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 12 16:13:58 devstack sudo[83734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:13:58 devstack sudo[83734]: pam_unix(sudo:session): session closed for user root
Aug 12 16:13:58 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.487s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:13:58 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:13:58 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:13:58 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:13:58 devstack sudo[83919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 12 16:13:58 devstack sudo[83919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:13:59 devstack sudo[83919]: pam_unix(sudo:session): session closed for user root
Aug 12 16:13:59 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:13:59 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:13:59 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:13:59 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:13:59 devstack sudo[84008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Aug 12 16:13:59 devstack sudo[84008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:13:59 devstack sudo[84008]: pam_unix(sudo:session): session closed for user root
Aug 12 16:13:59 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.277s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:13:59 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:13:59 devstack sudo[84077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 12 16:13:59 devstack sudo[84077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:13:59 devstack sudo[84077]: pam_unix(sudo:session): session closed for user root
Aug 12 16:13:59 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:13:59 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:13:59 devstack sudo[84156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 12 16:13:59 devstack sudo[84156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:13:59 devstack sudo[84156]: pam_unix(sudo:session): session closed for user root
Aug 12 16:13:59 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:13:59 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:13:59 devstack sudo[84177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 12 16:13:59 devstack sudo[84177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:14:00 devstack sudo[84177]: pam_unix(sudo:session): session closed for user root
Aug 12 16:14:00 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:14:00 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:14:00 devstack sudo[84243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 12 16:14:00 devstack sudo[84243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:14:00 devstack sudo[84243]: pam_unix(sudo:session): session closed for user root
Aug 12 16:14:00 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:14:00 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:14:00 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:14:00 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:14:00 devstack sudo[84253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 12 16:14:00 devstack sudo[84253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:14:00 devstack sudo[84253]: pam_unix(sudo:session): session closed for user root
Aug 12 16:14:00 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:14:00 devstack cinder-volume[83532]: INFO cinder.volume.drivers.lvm [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Aug 12 16:14:00 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:14:00 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:14:00 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:14:00 devstack sudo[84337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 12 16:14:00 devstack sudo[84337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:14:01 devstack sudo[84337]: pam_unix(sudo:session): session closed for user root
Aug 12 16:14:01 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.238s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:14:01 devstack cinder-volume[83532]: DEBUG cinder.volume.drivers.lvm [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Updating volume stats {{(pid=83532) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 12 16:14:01 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:14:01 devstack sudo[84340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 12 16:14:01 devstack sudo[84340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:14:01 devstack sudo[84340]: pam_unix(sudo:session): session closed for user root
Aug 12 16:14:01 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:14:01 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:14:01 devstack sudo[84349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 12 16:14:01 devstack sudo[84349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:14:01 devstack sudo[84349]: pam_unix(sudo:session): session closed for user root
Aug 12 16:14:01 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.234s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:14:01 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:14:01 devstack sudo[84352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 12 16:14:01 devstack sudo[84352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:14:01 devstack sudo[84352]: pam_unix(sudo:session): session closed for user root
Aug 12 16:14:01 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.233s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:14:01 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:14:01 devstack sudo[84355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 12 16:14:01 devstack sudo[84355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:14:01 devstack sudo[84355]: pam_unix(sudo:session): session closed for user root
Aug 12 16:14:02 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:14:02 devstack cinder-volume[83532]: INFO cinder.volume.driver [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Driver hasn't implemented _init_vendor_properties()
Aug 12 16:14:02 devstack cinder-volume[83532]: DEBUG cinder.volume.driver [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83532) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Aug 12 16:14:02 devstack cinder-volume[83532]: DEBUG oslo_db.sqlalchemy.engines [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83532) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 12 16:14:02 devstack cinder-volume[83532]: DEBUG dbcounter [-] [83532] Writer thread running {{(pid=83532) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 12 16:14:02 devstack cinder-volume[83532]: DEBUG cinder.db.api [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Building query based on filter {{(pid=83532) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Aug 12 16:14:02 devstack cinder-volume[83532]: DEBUG cinder.image.image_utils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83532) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Aug 12 16:14:02 devstack cinder-volume[83532]: INFO cinder.keymgr.migration [None req-6b27be26-faa1-411c-9390-a1593c5e36fa None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 12 16:14:02 devstack cinder-volume[83532]: DEBUG cinder.volume.drivers.lvm [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Updating volume stats {{(pid=83532) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 12 16:14:02 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:14:02 devstack sudo[84359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 12 16:14:02 devstack sudo[84359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:14:02 devstack sudo[84359]: pam_unix(sudo:session): session closed for user root
Aug 12 16:14:02 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:14:02 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:14:02 devstack sudo[84362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 12 16:14:02 devstack sudo[84362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:14:02 devstack sudo[84362]: pam_unix(sudo:session): session closed for user root
Aug 12 16:14:02 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:14:02 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:14:02 devstack sudo[84365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 12 16:14:02 devstack sudo[84365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:14:02 devstack sudo[84365]: pam_unix(sudo:session): session closed for user root
Aug 12 16:14:02 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:14:02 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:14:02 devstack sudo[84369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 12 16:14:02 devstack sudo[84369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:14:03 devstack sudo[84369]: pam_unix(sudo:session): session closed for user root
Aug 12 16:14:03 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:14:03 devstack cinder-volume[83532]: DEBUG cinder.manager [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Notifying Schedulers of capabilities ... {{(pid=83532) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:14:03 devstack cinder-volume[83532]: INFO cinder.volume.manager [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Driver initialization completed successfully.
Aug 12 16:14:03 devstack cinder-volume[83532]: INFO cinder.manager [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Initiating service 2 cleanup
Aug 12 16:14:03 devstack cinder-volume[83532]: INFO cinder.manager [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Service 2 cleanup completed.
Aug 12 16:14:03 devstack cinder-volume[83532]: DEBUG cinder.service [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Creating RPC server for service cinder-volume {{(pid=83532) start /opt/stack/cinder/cinder/service.py:231}}
Aug 12 16:14:03 devstack cinder-volume[83532]: DEBUG cinder.service [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83532) start /opt/stack/cinder/cinder/service.py:237}}
Aug 12 16:14:03 devstack cinder-volume[83532]: INFO cinder.volume.manager [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Aug 12 16:14:03 devstack cinder-volume[83532]: DEBUG cinder.volume.drivers.lvm [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Updating volume stats {{(pid=83532) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 12 16:14:03 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:14:03 devstack sudo[84374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 12 16:14:03 devstack sudo[84374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:14:03 devstack sudo[84374]: pam_unix(sudo:session): session closed for user root
Aug 12 16:14:03 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:14:03 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:14:03 devstack sudo[84377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 12 16:14:03 devstack sudo[84377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:14:03 devstack sudo[84377]: pam_unix(sudo:session): session closed for user root
Aug 12 16:14:03 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:14:03 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:14:03 devstack sudo[84382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 12 16:14:03 devstack sudo[84382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:14:04 devstack sudo[84382]: pam_unix(sudo:session): session closed for user root
Aug 12 16:14:04 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:14:04 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:14:04 devstack sudo[84385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 12 16:14:04 devstack sudo[84385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:14:04 devstack sudo[84385]: pam_unix(sudo:session): session closed for user root
Aug 12 16:14:04 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:14:04 devstack cinder-volume[83532]: INFO cinder.volume.manager [None req-bd57009a-4a12-4778-b6a0-bd4733e6bf77 None None] Driver post RPC initialization completed successfully.
Aug 12 16:14:07 devstack cinder-volume[83380]: DEBUG dbcounter [-] [83380] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83380) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:14:14 devstack cinder-volume[83532]: DEBUG dbcounter [-] [83532] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=83532) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:14:14 devstack cinder-volume[83532]: DEBUG dbcounter [-] [83532] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=83532) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:14:25 devstack cinder-volume[83532]: DEBUG oslo_service.periodic_task [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running periodic task VolumeManager._thread_info {{(pid=83532) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:14:25 devstack cinder-volume[83532]: DEBUG cinder.volume.manager [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] thread count: 6 {{(pid=83532) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:14:25 devstack cinder-volume[83532]: DEBUG cinder.volume.manager [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] thread info: [<_MainThread(MainThread, started 123315460780160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123315350576064)>, <Thread(Thread-3 (stat_writer), started daemon 123315348014784)>, <Thread(Rabbit-heartbeat, started daemon 123315351779520)>, <Thread(Thread-5 (_runner), started daemon 123315346933632)>, <Thread(Thread-7 (_runner), started daemon 123315347002624)>] {{(pid=83532) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:15:25 devstack cinder-volume[83532]: DEBUG oslo_service.periodic_task [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83532) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:15:25 devstack cinder-volume[83532]: DEBUG cinder.volume.drivers.lvm [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Updating volume stats {{(pid=83532) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 12 16:15:25 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:15:25 devstack sudo[87050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 12 16:15:25 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:15:25 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root
Aug 12 16:15:25 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:15:25 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:15:25 devstack sudo[87053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 12 16:15:25 devstack sudo[87053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:15:26 devstack sudo[87053]: pam_unix(sudo:session): session closed for user root
Aug 12 16:15:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:15:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:15:26 devstack sudo[87056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 12 16:15:26 devstack sudo[87056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:15:26 devstack sudo[87056]: pam_unix(sudo:session): session closed for user root
Aug 12 16:15:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.241s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:15:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:15:26 devstack sudo[87059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 12 16:15:26 devstack sudo[87059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:15:26 devstack sudo[87059]: pam_unix(sudo:session): session closed for user root
Aug 12 16:15:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:15:26 devstack cinder-volume[83532]: DEBUG cinder.manager [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Notifying Schedulers of capabilities ... {{(pid=83532) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:15:26 devstack cinder-volume[83532]: DEBUG oslo_service.periodic_task [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running periodic task VolumeManager._thread_info {{(pid=83532) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:15:26 devstack cinder-volume[83532]: DEBUG cinder.volume.manager [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] thread count: 6 {{(pid=83532) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:15:26 devstack cinder-volume[83532]: DEBUG cinder.volume.manager [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] thread info: [<_MainThread(MainThread, started 123315460780160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123315350576064)>, <Thread(Thread-3 (stat_writer), started daemon 123315348014784)>, <Thread(Rabbit-heartbeat, started daemon 123315351779520)>, <Thread(Thread-5 (_runner), started daemon 123315346933632)>, <Thread(Thread-7 (_runner), started daemon 123315347002624)>] {{(pid=83532) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:16:14 devstack cinder-volume[83532]: DEBUG dbcounter [-] [83532] Writing DB stats cinder:SELECT=1 {{(pid=83532) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:16:14 devstack cinder-volume[83532]: DEBUG dbcounter [-] [83532] Writing DB stats cinder:UPDATE=1 {{(pid=83532) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:16:25 devstack cinder-volume[83532]: DEBUG oslo_service.periodic_task [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83532) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:16:25 devstack cinder-volume[83532]: DEBUG cinder.volume.drivers.lvm [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Updating volume stats {{(pid=83532) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 12 16:16:25 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:16:25 devstack sudo[90043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 12 16:16:25 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:16:25 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root
Aug 12 16:16:25 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:16:25 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:16:25 devstack sudo[90046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 12 16:16:25 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:16:26 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root
Aug 12 16:16:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:16:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:16:26 devstack sudo[90049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 12 16:16:26 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:16:26 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root
Aug 12 16:16:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:16:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:16:26 devstack sudo[90052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 12 16:16:26 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:16:26 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root
Aug 12 16:16:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:16:26 devstack cinder-volume[83532]: DEBUG cinder.manager [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Notifying Schedulers of capabilities ... {{(pid=83532) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:16:26 devstack cinder-volume[83532]: DEBUG oslo_service.periodic_task [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running periodic task VolumeManager._thread_info {{(pid=83532) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:16:26 devstack cinder-volume[83532]: DEBUG cinder.volume.manager [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] thread count: 6 {{(pid=83532) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:16:26 devstack cinder-volume[83532]: DEBUG cinder.volume.manager [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] thread info: [<_MainThread(MainThread, started 123315460780160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123315350576064)>, <Thread(Thread-3 (stat_writer), started daemon 123315348014784)>, <Thread(Rabbit-heartbeat, started daemon 123315351779520)>, <Thread(Thread-5 (_runner), started daemon 123315346933632)>, <Thread(Thread-7 (_runner), started daemon 123315347002624)>] {{(pid=83532) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:17:25 devstack cinder-volume[83532]: DEBUG oslo_service.periodic_task [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83532) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:17:25 devstack cinder-volume[83532]: DEBUG cinder.volume.drivers.lvm [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Updating volume stats {{(pid=83532) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 12 16:17:25 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:17:25 devstack sudo[92302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 12 16:17:25 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:17:25 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root
Aug 12 16:17:25 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:17:25 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:17:25 devstack sudo[92308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 12 16:17:25 devstack sudo[92308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:17:26 devstack sudo[92308]: pam_unix(sudo:session): session closed for user root
Aug 12 16:17:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:17:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:17:26 devstack sudo[92311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 12 16:17:26 devstack sudo[92311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:17:26 devstack sudo[92311]: pam_unix(sudo:session): session closed for user root
Aug 12 16:17:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:17:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:17:26 devstack sudo[92315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 12 16:17:26 devstack sudo[92315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:17:26 devstack sudo[92315]: pam_unix(sudo:session): session closed for user root
Aug 12 16:17:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:17:26 devstack cinder-volume[83532]: DEBUG cinder.manager [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Notifying Schedulers of capabilities ... {{(pid=83532) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:17:26 devstack cinder-volume[83532]: DEBUG oslo_service.periodic_task [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running periodic task VolumeManager._thread_info {{(pid=83532) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:17:26 devstack cinder-volume[83532]: DEBUG cinder.volume.manager [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] thread count: 6 {{(pid=83532) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:17:26 devstack cinder-volume[83532]: DEBUG cinder.volume.manager [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] thread info: [<_MainThread(MainThread, started 123315460780160)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 123315350576064)>, <Thread(Thread-3 (stat_writer), started daemon 123315348014784)>, <Thread(Rabbit-heartbeat, started daemon 123315351779520)>, <Thread(Thread-5 (_runner), started daemon 123315346933632)>, <Thread(Thread-7 (_runner), started daemon 123315347002624)>] {{(pid=83532) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:18:14 devstack cinder-volume[83532]: DEBUG dbcounter [-] [83532] Writing DB stats cinder:SELECT=1 {{(pid=83532) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:18:14 devstack cinder-volume[83532]: DEBUG dbcounter [-] [83532] Writing DB stats cinder:UPDATE=1 {{(pid=83532) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:18:25 devstack cinder-volume[83380]: INFO oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Caught SIGTERM, stopping children
Aug 12 16:18:25 devstack cinder-volume[83380]: DEBUG oslo_concurrency.lockutils [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Acquiring lock "singleton_lock" {{(pid=83380) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 12 16:18:25 devstack cinder-volume[83380]: DEBUG oslo_concurrency.lockutils [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Acquired lock "singleton_lock" {{(pid=83380) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 12 16:18:25 devstack cinder-volume[83380]: DEBUG oslo_concurrency.lockutils [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Releasing lock "singleton_lock" {{(pid=83380) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 12 16:18:25 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Stop services. {{(pid=83380) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Aug 12 16:18:25 devstack cinder-volume[83380]: DEBUG oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Killing children. {{(pid=83380) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Aug 12 16:18:25 devstack cinder-volume[83380]: INFO oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Waiting on 1 children to exit
Aug 12 16:18:25 devstack cinder-volume[83532]: DEBUG oslo_service.periodic_task [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83532) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:18:25 devstack cinder-volume[83532]: DEBUG cinder.volume.drivers.lvm [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Updating volume stats {{(pid=83532) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Aug 12 16:18:25 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:18:25 devstack sudo[93648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Aug 12 16:18:25 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:18:25 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root
Aug 12 16:18:25 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:18:25 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:18:25 devstack sudo[93651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 12 16:18:25 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:18:26 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root
Aug 12 16:18:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:18:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:18:26 devstack sudo[93654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Aug 12 16:18:26 devstack sudo[93654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:18:26 devstack sudo[93654]: pam_unix(sudo:session): session closed for user root
Aug 12 16:18:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.252s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:18:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:18:26 devstack sudo[93657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Aug 12 16:18:26 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:18:26 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root
Aug 12 16:18:26 devstack cinder-volume[83532]: DEBUG oslo_concurrency.processutils [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=83532) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:18:26 devstack cinder-volume[83532]: DEBUG cinder.manager [None req-8dae06a4-04f9-4f23-a2b0-353042ebd17f None None] Notifying Schedulers of capabilities ... {{(pid=83532) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:18:28 devstack cinder-volume[83532]: DEBUG oslo_concurrency.lockutils [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Acquiring lock "singleton_lock" {{(pid=83532) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 12 16:18:28 devstack cinder-volume[83532]: DEBUG oslo_concurrency.lockutils [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Acquired lock "singleton_lock" {{(pid=83532) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 12 16:18:28 devstack cinder-volume[83532]: DEBUG oslo_concurrency.lockutils [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Releasing lock "singleton_lock" {{(pid=83532) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 12 16:18:28 devstack cinder-volume[83532]: WARNING amqp [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 12 16:18:28 devstack cinder-volume[83532]: WARNING amqp [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 12 16:18:28 devstack cinder-volume[83380]: INFO oslo_service.backend._eventlet.service [None req-14e45d42-1a1c-4e46-9ba8-f08099bc9aaf None None] Child 83532 exited with status 0
Aug 12 16:18:28 devstack cinder-volume[93661]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Aug 12 16:18:28 devstack cinder-volume[93661]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 12 16:18:28 devstack cinder-volume[93661]: we strongly recommend against using it for new projects.
Aug 12 16:18:28 devstack cinder-volume[93661]: If you are already using Eventlet, we recommend migrating to a different
Aug 12 16:18:28 devstack cinder-volume[93661]: framework.  For more detail see
Aug 12 16:18:28 devstack cinder-volume[93661]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 12 16:18:28 devstack cinder-volume[93661]:   import eventlet  # noqa
Aug 12 16:18:30 devstack cinder-volume[93661]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 12 16:18:30 devstack cinder-volume[93661]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 12 16:18:30 devstack cinder-volume[93661]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 12 16:18:31 devstack cinder-volume[93661]: INFO dbcounter [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Registered counter for database cinder
Aug 12 16:18:31 devstack cinder-volume[93661]: DEBUG oslo_db.sqlalchemy.engines [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93661) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 12 16:18:31 devstack cinder-volume[93661]: DEBUG dbcounter [-] [93661] Writer thread running {{(pid=93661) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 12 16:18:31 devstack cinder-volume[93661]: INFO cinder.rpc [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Aug 12 16:18:31 devstack cinder-volume[93661]: INFO cinder.rpc [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Aug 12 16:18:31 devstack cinder-volume[93661]: DEBUG oslo_db.sqlalchemy.engines [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93661) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 12 16:18:32 devstack cinder-volume[93661]: INFO cinder.volume.manager [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Determined volume DB was empty at startup.
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG cinder.volume.manager [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93661) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Aug 12 16:18:32 devstack cinder-volume[93661]: INFO cinder.volume.manager [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Service not found for updating active_backend_id, assuming default for driver init.
Aug 12 16:18:32 devstack cinder-volume[93661]: WARNING stevedore.named [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 12 16:18:32 devstack cinder-volume[93661]: WARNING castellan.key_manager [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 12 16:18:32 devstack cinder-volume[93661]: WARNING cinder.keymgr.conf_key_mgr [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 12 16:18:32 devstack cinder-volume[93661]: INFO cinder.volume.manager [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_db.sqlalchemy.engines [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93661) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 12 16:18:32 devstack cinder-volume[93661]: INFO oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Starting 1 workers
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Started child 93884 {{(pid=93661) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Full set of CONF: {{(pid=93661) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] ******************************************************************************** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Configuration options gathered from: {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] ================================================================================ {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] allow_availability_zone_fallback = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] allow_compression_on_image_upload = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] allowed_direct_url_schemes     = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] api_rate_limit                 = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] auth_strategy                  = keystone {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_availability_zone      = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_host                   = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_name                   = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_stats_polling_interval = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backup_api_class               = cinder.backup.api.API {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backup_name_template           = backup-%s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93884]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backup_use_same_host           = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backup_use_temp_snapshot       = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] chap_password                  = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] chap_username                  =  {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cinder_internal_tenant_project_id = 19d6a7f8343e4ad58925252ca12fdd31 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cinder_internal_tenant_user_id = 3b62e6b455b14b0ca66a633e3e1d366c {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cluster                        = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] compression_format             = gzip {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] compute_api_class              = cinder.compute.nova.API {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] config_dir                     = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] config_source                  = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] control_exchange               = openstack {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] debug                          = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] default_availability_zone      = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] default_group_type             = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] default_volume_type            = QuobyteHD {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] disk_geometry                  = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] driver_client_cert             = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] driver_client_cert_key         = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] driver_data_namespace          = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] driver_ssl_cert_path           = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] driver_ssl_cert_verify         = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] driver_use_ssl                 = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] enable_new_services            = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] enable_unsupported_driver      = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] enabled_backends               = ['QuobyteHD'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] enforce_multipath_for_image_xfer = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] filter_function                = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance_api_insecure            = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance_api_servers             = ['http://192.168.122.135/image'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance_api_ssl_compression     = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance_ca_certificates_file    = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance_catalog_info            = image:glance:publicURL {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance_certfile                = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance_keyfile                 = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance_num_retries             = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance_request_timeout         = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] goodness_function              = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] graceful_shutdown_timeout      = 5 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] group_api_class                = cinder.group.api.API {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] host                           = devstack {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] image_compress_on_upload       = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] image_conversion_address_space_limit = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] image_conversion_cpu_limit     = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] image_conversion_disable       = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] image_upload_use_cinder_backend = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] image_upload_use_internal_tenant = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] image_volume_cache_enabled     = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] image_volume_cache_max_count   = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] image_volume_cache_max_size_gb = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] init_host_max_objects_retrieval = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] instance_format                = [instance: %(uuid)s]  {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] iscsi_target_flags             =  {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] iscsi_write_cache              = on {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] iser_helper                    = tgtadm {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] iser_ip_address                = 192.168.122.135 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] iser_port                      = 3260 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] log_color                      = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] log_config_append              = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] log_dir                        = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] log_file                       = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] log_options                    = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] log_rotate_interval            = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] log_rotate_interval_type       = days {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] log_rotation_type              = none {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] max_age                        = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] max_logfile_count              = 30 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] max_logfile_size_mb            = 200 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] max_over_subscription_ratio    = 20.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] message_reap_interval          = 86400 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] message_ttl                    = 2592000 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] migration_create_volume_timeout_secs = 300 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] monkey_patch                   = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] monkey_patch_modules           = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93884]: INFO cinder.volume.manager [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Starting volume driver QuobyteDriver (1.2)
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] my_ip                          = 192.168.122.135 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93884]: DEBUG cinder.volume.drivers.remotefs [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93884) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] no_snapshot_gb_quota           = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] num_iser_scan_tries            = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] num_shell_tries                = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] num_volume_device_scan_tries   = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] nvmeof_conn_info_version       = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] nvmet_ns_id                    = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] nvmet_port_id                  = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] osapi_max_limit                = 1000 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] osapi_volume_ext_list          = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] osapi_volume_listen_port       = 8776 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] osapi_volume_use_ssl           = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] osapi_volume_workers           = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] per_volume_size_limit          = -1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] periodic_fuzzy_delay           = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] periodic_interval              = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] public_endpoint                = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] publish_errors                 = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] quota_backup_gigabytes         = 1000 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] quota_backups                  = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] quota_gigabytes                = 1000 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] quota_groups                   = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] quota_snapshots                = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] quota_volumes                  = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] rate_limit_burst               = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] rate_limit_except_level        = CRITICAL {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] rate_limit_interval            = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] reinit_driver_count            = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] replication_device             = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] report_discard_supported       = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] report_interval                = 120 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] reservation_clean_interval     = 86400 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] reservation_expire             = 86400 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] reserved_image_namespaces      = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] reserved_percentage            = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] rpc_response_timeout           = 120 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] run_external_periodic_tasks    = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] scst_target_driver             = iscsi {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] scst_target_iqn_name           = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] service_down_time              = 720 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] shell_completion               = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] snapshot_name_template         = snapshot-%s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] split_loggers                  = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] state_path                     = /opt/stack/data/cinder {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] storage_availability_zone      = nova {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] storage_protocol               = iSCSI {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] syslog_log_facility            = LOG_USER {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] target_helper                  = lioadm {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] target_ip_address              = 192.168.122.135 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] target_port                    = 3260 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] target_protocol                = iscsi {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] target_secondary_ip_addresses  = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] trace_flags                    = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] transport_url                  = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] until_refresh                  = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] use_chap_auth                  = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] use_default_quota_class        = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] use_journal                    = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] use_json                       = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] use_multipath_for_image_xfer   = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] use_stderr                     = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] use_syslog                     = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] verify_glance_signatures       = enabled {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] volume_api_class               = cinder.volume.api.API {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] volume_backend_name            = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] volume_clear                   = zero {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] volume_clear_ionice            = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] volume_clear_size              = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] volume_copy_bps_limit          = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] volume_dd_blocksize            = 1M {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] volume_name_template           = volume-%s {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] volume_service_inithost_offload = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] volume_usage_audit_period      = month {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] zoning_mode                    = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_concurrency.disable_process_locking = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.auth_section = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.auth_type   = password {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.auth_version = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.cache       = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.certfile    = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.include_service_catalog = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.insecure    = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.interface   = public {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.keyfile     = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.memcache_password =  {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.memcache_username =  {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.region_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.service_type = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.backend                  = dogpile.cache.null {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.backend_argument         = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.backend_expiration_time  = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.config_prefix            = cache.oslo {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.debug_cache_backend      = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.enable_retry_client      = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.enable_socket_keepalive  = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.enabled                  = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.expiration_time          = 600 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.hashclient_retry_attempts = 2 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.memcache_dead_retry      = 300 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.memcache_pool_maxsize    = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.memcache_sasl_enabled    = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.password                 = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.proxies                  = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.redis_db                 = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.redis_server             = localhost:6379 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.retry_attempts           = 2 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.retry_delay              = 0.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.socket_keepalive_count   = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.socket_keepalive_idle    = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.socket_keepalive_interval = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.socket_timeout           = 1.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.tls_allowed_ciphers      = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.tls_cafile               = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.tls_certfile             = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.tls_enabled              = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.tls_keyfile              = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cache.username                 = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] coordination.backend_url       = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.asyncio_connection    = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.asyncio_slave_connection = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.backend               = sqlalchemy {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.connection            = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.connection_debug      = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.connection_parameters =  {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.connection_recycle_time = 3600 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.connection_trace      = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.db_inc_retry_interval = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.db_max_retries        = 20 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.db_max_retry_interval = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.db_retry_interval     = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.max_overflow          = 50 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.max_pool_size         = 5 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.max_retries           = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.mysql_wsrep_sync_wait = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.pool_timeout          = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.retry_interval        = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.slave_connection      = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.sqlite_synchronous    = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.synchronous_reader    = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] database.use_db_reconnect      = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] profiler.connection_string     = messaging:// {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] profiler.enabled               = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] profiler.es_doc_type           = notification {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] profiler.es_scroll_size        = 10000 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] profiler.es_scroll_time        = 2m {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] profiler.filter_error_trace    = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] profiler.hmac_keys             = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] profiler.sentinel_service_name = mymaster {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] profiler.socket_timeout        = 0.1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] profiler.trace_requests        = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93884]: DEBUG cinder.volume.drivers.quobyte [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93884) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Aug 12 16:18:32 devstack cinder-volume[93884]: WARNING cinder.volume.drivers.quobyte [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] profiler.trace_sqlalchemy      = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] profiler_jaeger.process_tags   = {} {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] profiler_jaeger.service_name_prefix = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] profiler_otlp.service_name_prefix = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_policy.enforce_new_defaults = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93884]: WARNING cinder.volume.drivers.quobyte [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_policy.policy_default_rule = default {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_policy.policy_file        = policy.yaml {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93884]: DEBUG oslo_concurrency.processutils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Running cmd (subprocess): mount.quobyte {{(pid=93884) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] privsep_osbrick.group          = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] privsep_osbrick.helper_command = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] privsep_osbrick.user           = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cinder_sys_admin.group         = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cinder_sys_admin.helper_command = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] cinder_sys_admin.user          = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] service_user.auth_section      = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] service_user.auth_type         = password {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] service_user.cafile            = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] service_user.certfile          = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] service_user.collect_timing    = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] service_user.insecure          = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] service_user.keyfile           = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] service_user.send_service_user_token = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] service_user.split_loggers     = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] service_user.timeout           = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance.auth_section            = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance.auth_type               = password {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance.certfile                = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance.collect_timing          = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance.insecure                = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance.keyfile                 = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance.region_name             = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance.split_loggers           = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] glance.timeout                 = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.backend_availability_zone = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.chap_password = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.chap_username =  {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.disk_geometry = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.driver_client_cert = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.driver_client_cert_key = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.driver_data_namespace = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.driver_use_ssl = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.extra_capabilities = {} {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.filter_function = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.goodness_function = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.iscsi_target_flags =  {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.iscsi_write_cache = on {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.iser_helper   = tgtadm {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.iser_port     = 3260 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.nas_host      =  {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.nas_login     = admin {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.nas_mount_options = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.nas_password  = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.nas_private_key =  {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.nas_share_path =  {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.num_shell_tries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.quobyte_volume_url = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.replication_device = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.report_discard_supported = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.reserved_percentage = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.target_helper = tgtadm {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.target_port   = 3260 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.target_protocol = iscsi {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.trace_flags   = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.unique_fqdn_network = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.use_chap_auth = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.volume_backend_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.volume_clear  = zero {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.volume_clear_ionice = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.volume_clear_size = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_reports.file_event_handler = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_reports.log_dir           = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.backend_availability_zone = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.backend_host         = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.chap_password        = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.chap_username        = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.chiscsi_conf         = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.disk_geometry        = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.driver_client_cert   = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.driver_data_namespace = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.driver_use_ssl       = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.extra_capabilities   = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.filter_function      = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.goodness_function    = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.iser_helper          = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.iser_ip_address      = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.iser_port            = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.iser_target_prefix   = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.nas_host             = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.nas_login            = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.nas_mount_options    = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.nas_password         = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.nas_private_key      = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.nas_share_path       = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.nas_ssh_port         = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.num_shell_tries      = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.nvmet_port_id        = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.replication_device   = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.report_discard_supported = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.reserved_percentage  = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.scst_target_driver   = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack quobyte-client[93889]: Reading configuration file: /etc/quobyte/client.cfg
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.storage_protocol     = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.target_helper        = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.target_ip_address    = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.target_port          = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack quobyte-client[93889]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.target_prefix        = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.target_protocol      = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.trace_flags          = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93884]: DEBUG oslo_concurrency.processutils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] CMD "mount.quobyte" returned: 1 in 0.064s {{(pid=93884) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.use_chap_auth        = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93884]: DEBUG oslo_concurrency.lockutils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93884) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.volume_clear         = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93884]: DEBUG oslo_concurrency.lockutils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93884) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.volume_clear_size    = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93884]: DEBUG cinder.volume.drivers.quobyte [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=93884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] QuobyteHD.volumes_dir          = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93884]: INFO cinder.volume.drivers.quobyte [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 ...
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93884]: DEBUG oslo_concurrency.processutils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 -c /etc/quobyte/client-cinder.cfg {{(pid=93884) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.ssl      = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_notifications.driver = [] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_notifications.retry = -1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack sudo[93890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 -c /etc/quobyte/client-cinder.cfg
Aug 12 16:18:32 devstack sudo[93890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] key_manager.fixed_key          = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican.barbican_api_version  = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican.barbican_endpoint     = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican.barbican_endpoint_type = public {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican.barbican_region_name  = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican.cafile                = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican.certfile              = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican.collect_timing        = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican.insecure              = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican.keyfile               = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican.number_of_retries     = 60 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican.retry_delay           = 1 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican.send_service_user_token = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican.split_loggers         = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican.timeout               = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican.verify_ssl            = True {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican.verify_ssl_path       = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican_service_user.auth_section = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican_service_user.auth_type = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican_service_user.cafile   = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican_service_user.certfile = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican_service_user.collect_timing = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican_service_user.insecure = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican_service_user.keyfile  = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican_service_user.split_loggers = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] barbican_service_user.timeout  = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] vault.approle_role_id          = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] vault.approle_secret_id        = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] vault.auth_method              = approle {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] vault.auth_path                = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] vault.kv_mountpoint            = secret {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] vault.kv_path                  = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] vault.kv_version               = 2 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] vault.namespace                = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] vault.root_token_id            = **** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] vault.ssl_ca_crt_file          = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] vault.timeout                  = 60.0 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] vault.token_file               = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] vault.token_role               = None {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] vault.use_ssl                  = False {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:32 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] ******************************************************************************** {{(pid=93661) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}}
Aug 12 16:18:32 devstack sudo[93890]: pam_unix(sudo:session): session closed for user root
Aug 12 16:18:32 devstack cinder-volume[93884]: DEBUG oslo_concurrency.processutils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.358s {{(pid=93884) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:18:32 devstack cinder-volume[93884]: INFO cinder.volume.drivers.quobyte [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 succeeded
Aug 12 16:18:32 devstack cinder-volume[93884]: DEBUG cinder.volume.drivers.quobyte [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=93884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:18:32 devstack cinder-volume[93884]: DEBUG oslo_concurrency.lockutils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.371s {{(pid=93884) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:18:32 devstack cinder-volume[93884]: DEBUG oslo_concurrency.processutils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=93884) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:18:32 devstack sudo[93959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:18:32 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:18:33 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG oslo_concurrency.processutils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.230s {{(pid=93884) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:18:33 devstack cinder-volume[93884]: INFO cinder.volume.driver [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Driver hasn't implemented _init_vendor_properties()
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG cinder.volume.driver [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93884) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG oslo_db.sqlalchemy.engines [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93884) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG dbcounter [-] [93884] Writer thread running {{(pid=93884) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG cinder.db.api [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Building query based on filter {{(pid=93884) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG cinder.image.image_utils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93884) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Aug 12 16:18:33 devstack cinder-volume[93884]: INFO cinder.keymgr.migration [None req-720ae67a-3b96-496a-98ba-a8f48bd267e9 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG oslo_concurrency.lockutils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93884) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG oslo_concurrency.lockutils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93884) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG cinder.volume.drivers.quobyte [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=93884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG cinder.volume.drivers.quobyte [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=93884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG oslo_concurrency.lockutils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93884) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG oslo_concurrency.processutils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=93884) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:18:33 devstack sudo[93962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:18:33 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:18:33 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG oslo_concurrency.processutils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.220s {{(pid=93884) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG cinder.manager [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Notifying Schedulers of capabilities ... {{(pid=93884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:18:33 devstack cinder-volume[93884]: INFO cinder.volume.manager [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Driver initialization completed successfully.
Aug 12 16:18:33 devstack cinder-volume[93884]: INFO cinder.manager [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Initiating service 3 cleanup
Aug 12 16:18:33 devstack cinder-volume[93884]: INFO cinder.manager [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Service 3 cleanup completed.
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG cinder.service [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Creating RPC server for service cinder-volume {{(pid=93884) start /opt/stack/cinder/cinder/service.py:231}}
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG cinder.service [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93884) start /opt/stack/cinder/cinder/service.py:237}}
Aug 12 16:18:33 devstack cinder-volume[93884]: INFO cinder.volume.manager [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2)
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG oslo_concurrency.lockutils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93884) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG oslo_concurrency.lockutils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93884) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG cinder.volume.drivers.quobyte [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=93884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG cinder.volume.drivers.quobyte [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=93884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG oslo_concurrency.lockutils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93884) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG oslo_concurrency.processutils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=93884) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:18:33 devstack sudo[93965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:18:33 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:18:33 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root
Aug 12 16:18:33 devstack cinder-volume[93884]: DEBUG oslo_concurrency.processutils [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.273s {{(pid=93884) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:18:33 devstack cinder-volume[93884]: INFO cinder.volume.manager [None req-e02ec6e0-cf18-4dba-af8f-62fcaf8b3e1c None None] Driver post RPC initialization completed successfully.
Aug 12 16:18:38 devstack cinder-volume[93884]: DEBUG oslo_concurrency.lockutils [None req-4866f716-b921-443d-a9c3-bc0a1d79fb1d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93884) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:18:38 devstack cinder-volume[93884]: DEBUG oslo_concurrency.lockutils [None req-4866f716-b921-443d-a9c3-bc0a1d79fb1d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93884) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:18:38 devstack cinder-volume[93884]: DEBUG cinder.volume.drivers.quobyte [None req-4866f716-b921-443d-a9c3-bc0a1d79fb1d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=93884) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:18:38 devstack cinder-volume[93884]: DEBUG cinder.volume.drivers.quobyte [None req-4866f716-b921-443d-a9c3-bc0a1d79fb1d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=93884) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:18:38 devstack cinder-volume[93884]: DEBUG oslo_concurrency.lockutils [None req-4866f716-b921-443d-a9c3-bc0a1d79fb1d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93884) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:18:38 devstack cinder-volume[93884]: DEBUG oslo_concurrency.processutils [None req-4866f716-b921-443d-a9c3-bc0a1d79fb1d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=93884) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:18:38 devstack sudo[94095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:18:38 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:18:38 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root
Aug 12 16:18:38 devstack cinder-volume[93884]: DEBUG oslo_concurrency.processutils [None req-4866f716-b921-443d-a9c3-bc0a1d79fb1d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.251s {{(pid=93884) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:18:38 devstack cinder-volume[93884]: DEBUG cinder.manager [None req-4866f716-b921-443d-a9c3-bc0a1d79fb1d None None] Notifying Schedulers of capabilities ... {{(pid=93884) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:18:39 devstack cinder-volume[93661]: INFO oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Caught SIGTERM, stopping children
Aug 12 16:18:39 devstack cinder-volume[93661]: DEBUG oslo_concurrency.lockutils [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Acquiring lock "singleton_lock" {{(pid=93661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 12 16:18:39 devstack cinder-volume[93661]: DEBUG oslo_concurrency.lockutils [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Acquired lock "singleton_lock" {{(pid=93661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 12 16:18:39 devstack cinder-volume[93661]: DEBUG oslo_concurrency.lockutils [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Releasing lock "singleton_lock" {{(pid=93661) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 12 16:18:39 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Stop services. {{(pid=93661) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Aug 12 16:18:39 devstack cinder-volume[93661]: DEBUG oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Killing children. {{(pid=93661) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Aug 12 16:18:39 devstack cinder-volume[93661]: INFO oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Waiting on 1 children to exit
Aug 12 16:18:41 devstack cinder-volume[93884]: DEBUG oslo_concurrency.lockutils [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Acquiring lock "singleton_lock" {{(pid=93884) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 12 16:18:41 devstack cinder-volume[93884]: DEBUG oslo_concurrency.lockutils [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Acquired lock "singleton_lock" {{(pid=93884) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 12 16:18:41 devstack cinder-volume[93884]: DEBUG oslo_concurrency.lockutils [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Releasing lock "singleton_lock" {{(pid=93884) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 12 16:18:41 devstack cinder-volume[93884]: WARNING amqp [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 12 16:18:41 devstack cinder-volume[93884]: WARNING amqp [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Aug 12 16:18:41 devstack cinder-volume[93661]: INFO oslo_service.backend._eventlet.service [None req-fa4fc7d7-7844-4345-91f3-5bce054d5495 None None] Child 93884 exited with status 0
Aug 12 16:18:42 devstack cinder-volume[94167]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Aug 12 16:18:42 devstack cinder-volume[94167]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 12 16:18:42 devstack cinder-volume[94167]: we strongly recommend against using it for new projects.
Aug 12 16:18:42 devstack cinder-volume[94167]: If you are already using Eventlet, we recommend migrating to a different
Aug 12 16:18:42 devstack cinder-volume[94167]: framework.  For more detail see
Aug 12 16:18:42 devstack cinder-volume[94167]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 12 16:18:42 devstack cinder-volume[94167]:   import eventlet  # noqa
Aug 12 16:18:45 devstack cinder-volume[94167]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=94167) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Aug 12 16:18:45 devstack cinder-volume[94167]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=94167) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Aug 12 16:18:45 devstack cinder-volume[94167]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=94167) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Aug 12 16:18:46 devstack cinder-volume[94167]: INFO dbcounter [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] Registered counter for database cinder
Aug 12 16:18:46 devstack cinder-volume[94167]: DEBUG oslo_db.sqlalchemy.engines [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94167) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 12 16:18:46 devstack cinder-volume[94167]: DEBUG dbcounter [-] [94167] Writer thread running {{(pid=94167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 12 16:18:46 devstack cinder-volume[94167]: INFO cinder.rpc [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Aug 12 16:18:46 devstack cinder-volume[94167]: INFO cinder.rpc [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_db.sqlalchemy.engines [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94167) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 12 16:18:47 devstack cinder-volume[94167]: INFO cinder.volume.manager [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] Determined volume DB was empty at startup.
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG cinder.volume.manager [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=94167) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Aug 12 16:18:47 devstack cinder-volume[94167]: WARNING stevedore.named [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Aug 12 16:18:47 devstack cinder-volume[94167]: WARNING castellan.key_manager [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 12 16:18:47 devstack cinder-volume[94167]: WARNING cinder.keymgr.conf_key_mgr [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Aug 12 16:18:47 devstack cinder-volume[94167]: INFO cinder.volume.manager [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_db.sqlalchemy.engines [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94167) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 12 16:18:47 devstack cinder-volume[94167]: INFO oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] Starting 1 workers
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] Started child 94457 {{(pid=94167) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] Full set of CONF: {{(pid=94167) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] ******************************************************************************** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] Configuration options gathered from: {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}}
Aug 12 16:18:47 devstack cinder-volume[94457]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] ================================================================================ {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] allow_availability_zone_fallback = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] allow_compression_on_image_upload = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] allowed_direct_url_schemes     = [] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] api_rate_limit                 = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] auth_strategy                  = keystone {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_availability_zone      = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_host                   = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_name                   = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_stats_polling_interval = 60 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backup_api_class               = cinder.backup.api.API {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backup_name_template           = backup-%s {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backup_use_same_host           = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backup_use_temp_snapshot       = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] chap_password                  = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] chap_username                  =  {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cinder_internal_tenant_project_id = 19d6a7f8343e4ad58925252ca12fdd31 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cinder_internal_tenant_user_id = 3b62e6b455b14b0ca66a633e3e1d366c {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cluster                        = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] compression_format             = gzip {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] compute_api_class              = cinder.compute.nova.API {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] config_dir                     = [] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] config_source                  = [] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] control_exchange               = openstack {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] debug                          = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] default_availability_zone      = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] default_group_type             = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] default_volume_type            = QuobyteHD {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] disk_geometry                  = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] driver_client_cert             = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] driver_client_cert_key         = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] driver_data_namespace          = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] driver_ssl_cert_path           = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] driver_ssl_cert_verify         = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] driver_use_ssl                 = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] enable_new_services            = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] enable_unsupported_driver      = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] enabled_backends               = ['QuobyteHD'] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] enforce_multipath_for_image_xfer = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] filter_function                = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance_api_insecure            = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance_api_servers             = ['http://192.168.122.135/image'] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance_api_ssl_compression     = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance_ca_certificates_file    = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance_catalog_info            = image:glance:publicURL {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance_certfile                = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance_keyfile                 = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance_num_retries             = 3 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance_request_timeout         = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] goodness_function              = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] graceful_shutdown_timeout      = 5 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] group_api_class                = cinder.group.api.API {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] host                           = devstack {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] image_compress_on_upload       = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] image_conversion_address_space_limit = 1 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] image_conversion_cpu_limit     = 60 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] image_conversion_disable       = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] image_upload_use_cinder_backend = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] image_upload_use_internal_tenant = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] image_volume_cache_enabled     = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] image_volume_cache_max_count   = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] image_volume_cache_max_size_gb = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] init_host_max_objects_retrieval = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] instance_format                = [instance: %(uuid)s]  {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] iscsi_target_flags             =  {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] iscsi_write_cache              = on {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] iser_helper                    = tgtadm {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] iser_ip_address                = 192.168.122.135 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] iser_port                      = 3260 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] log_color                      = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] log_config_append              = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] log_dir                        = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] log_file                       = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] log_options                    = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] log_rotate_interval            = 1 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] log_rotate_interval_type       = days {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] log_rotation_type              = none {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] max_age                        = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] max_logfile_count              = 30 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] max_logfile_size_mb            = 200 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] max_over_subscription_ratio    = 20.0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Starting volume driver QuobyteDriver (1.2)
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] message_reap_interval          = 86400 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=94457) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] message_ttl                    = 2592000 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] migration_create_volume_timeout_secs = 300 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] monkey_patch                   = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] monkey_patch_modules           = [] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] my_ip                          = 192.168.122.135 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] no_snapshot_gb_quota           = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] num_iser_scan_tries            = 3 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] num_shell_tries                = 3 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] num_volume_device_scan_tries   = 3 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] nvmeof_conn_info_version       = 1 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] nvmet_ns_id                    = 10 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] nvmet_port_id                  = 1 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] osapi_max_limit                = 1000 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] osapi_volume_ext_list          = [] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] osapi_volume_listen_port       = 8776 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] osapi_volume_use_ssl           = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] osapi_volume_workers           = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] per_volume_size_limit          = -1 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] periodic_fuzzy_delay           = 60 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] periodic_interval              = 60 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] public_endpoint                = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] publish_errors                 = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] quota_backup_gigabytes         = 1000 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] quota_backups                  = 10 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] quota_gigabytes                = 1000 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] quota_groups                   = 10 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] quota_snapshots                = 10 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] quota_volumes                  = 10 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] rate_limit_burst               = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] rate_limit_except_level        = CRITICAL {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] rate_limit_interval            = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] reinit_driver_count            = 3 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] replication_device             = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] report_discard_supported       = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] report_interval                = 120 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] reservation_clean_interval     = 86400 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] reservation_expire             = 86400 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] reserved_image_namespaces      = [] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] reserved_percentage            = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] rpc_response_timeout           = 120 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] run_external_periodic_tasks    = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] scst_target_driver             = iscsi {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] scst_target_iqn_name           = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] service_down_time              = 720 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] shell_completion               = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] snapshot_name_template         = snapshot-%s {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] split_loggers                  = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] state_path                     = /opt/stack/data/cinder {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] storage_availability_zone      = nova {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] storage_protocol               = iSCSI {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] syslog_log_facility            = LOG_USER {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] target_helper                  = lioadm {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] target_ip_address              = 192.168.122.135 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] target_port                    = 3260 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] target_protocol                = iscsi {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] target_secondary_ip_addresses  = [] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] trace_flags                    = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] transport_url                  = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] until_refresh                  = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] use_chap_auth                  = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] use_default_quota_class        = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] use_journal                    = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] use_json                       = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] use_multipath_for_image_xfer   = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] use_stderr                     = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] use_syslog                     = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] verify_glance_signatures       = enabled {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] volume_api_class               = cinder.volume.api.API {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] volume_backend_name            = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] volume_clear                   = zero {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] volume_clear_ionice            = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] volume_clear_size              = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] volume_copy_bps_limit          = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] volume_dd_blocksize            = 1M {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] volume_name_template           = volume-%s {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] volume_service_inithost_offload = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] volume_usage_audit_period      = month {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] zoning_mode                    = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_concurrency.disable_process_locking = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.auth_section = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.auth_type   = password {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.auth_version = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.cache       = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.certfile    = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.delay_auth_decision = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.http_connect_timeout = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.include_service_catalog = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.insecure    = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.interface   = public {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.keyfile     = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.memcache_password =  {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.memcache_username =  {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.region_name = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.service_token_roles_required = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.service_type = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.token_cache_time = 300 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.135/identity {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.backend                  = dogpile.cache.null {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.backend_argument         = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.backend_expiration_time  = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.config_prefix            = cache.oslo {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.debug_cache_backend      = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.enable_retry_client      = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.enable_socket_keepalive  = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.enabled                  = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.expiration_time          = 600 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.hashclient_retry_attempts = 2 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.memcache_dead_retry      = 300 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.memcache_pool_maxsize    = 10 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.memcache_sasl_enabled    = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.password                 = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.proxies                  = [] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.redis_db                 = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.redis_sentinel_service_name = mymaster {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.redis_server             = localhost:6379 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.retry_attempts           = 2 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.retry_delay              = 0.0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.socket_keepalive_count   = 1 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.socket_keepalive_idle    = 1 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.socket_keepalive_interval = 1 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.socket_timeout           = 1.0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.tls_allowed_ciphers      = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.tls_cafile               = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.tls_certfile             = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.tls_enabled              = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.tls_keyfile              = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cache.username                 = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] coordination.backend_url       = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.asyncio_connection    = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.asyncio_slave_connection = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.backend               = sqlalchemy {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.connection            = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.connection_debug      = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.connection_parameters =  {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.connection_recycle_time = 3600 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.connection_trace      = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.db_inc_retry_interval = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.db_max_retries        = 20 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.db_max_retry_interval = 10 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.db_retry_interval     = 1 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.max_overflow          = 50 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.max_pool_size         = 5 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.max_retries           = 10 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.mysql_wsrep_sync_wait = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.pool_timeout          = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.retry_interval        = 10 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.slave_connection      = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.sqlite_synchronous    = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.synchronous_reader    = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] database.use_db_reconnect      = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] profiler.connection_string     = messaging:// {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] profiler.enabled               = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] profiler.es_doc_type           = notification {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] profiler.es_scroll_size        = 10000 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] profiler.es_scroll_time        = 2m {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] profiler.filter_error_trace    = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] profiler.hmac_keys             = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] profiler.sentinel_service_name = mymaster {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] profiler.socket_timeout        = 0.1 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] profiler.trace_requests        = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] profiler.trace_sqlalchemy      = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] profiler_jaeger.process_tags   = {} {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] profiler_jaeger.service_name_prefix = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] profiler_otlp.service_name_prefix = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_policy.enforce_new_defaults = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_policy.policy_default_rule = default {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_policy.policy_file        = policy.yaml {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=94457) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Aug 12 16:18:47 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.quobyte [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] privsep_osbrick.group          = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] privsep_osbrick.helper_command = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] privsep_osbrick.user           = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cinder_sys_admin.group         = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cinder_sys_admin.helper_command = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] cinder_sys_admin.user          = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] service_user.auth_section      = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] service_user.auth_type         = password {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.quobyte [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] service_user.cafile            = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] service_user.certfile          = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] service_user.collect_timing    = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] service_user.insecure          = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] service_user.keyfile           = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] service_user.send_service_user_token = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Running cmd (subprocess): mount.quobyte {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] service_user.split_loggers     = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] service_user.timeout           = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance.auth_section            = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance.auth_type               = password {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance.certfile                = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance.collect_timing          = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance.insecure                = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance.keyfile                 = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance.region_name             = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance.split_loggers           = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] glance.timeout                 = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.backend_availability_zone = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.chap_password = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.chap_username =  {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.disk_geometry = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.driver_client_cert = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.driver_client_cert_key = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.driver_data_namespace = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.driver_use_ssl = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.enable_unsupported_driver = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.extra_capabilities = {} {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.filter_function = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.goodness_function = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.iscsi_target_flags =  {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.iscsi_write_cache = on {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.iser_helper   = tgtadm {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.iser_ip_address = 192.168.122.135 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.iser_port     = 3260 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.nas_host      =  {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.nas_login     = admin {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.nas_mount_options = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.nas_password  = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.nas_private_key =  {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.nas_share_path =  {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.num_shell_tries = 3 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.nvmet_port_id = 1 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.quobyte_client_cfg = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.quobyte_volume_url = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.replication_device = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.report_discard_supported = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.reserved_percentage = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.scst_target_driver = iscsi {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.scst_target_iqn_name = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.storage_protocol = iSCSI {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.target_helper = tgtadm {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.target_ip_address = 192.168.122.135 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.target_port   = 3260 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.target_protocol = iscsi {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.trace_flags   = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.unique_fqdn_network = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.use_chap_auth = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.volume_backend_name = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.volume_clear  = zero {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.volume_clear_ionice = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.volume_clear_size = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_reports.file_event_handler = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_reports.log_dir           = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.backend_availability_zone = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.backend_host         = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.chap_password        = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.chap_username        = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.chiscsi_conf         = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.disk_geometry        = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.driver_client_cert   = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.driver_client_cert_key = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.driver_data_namespace = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.driver_use_ssl       = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.extra_capabilities   = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.filter_function      = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.goodness_function    = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.iser_helper          = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.iser_ip_address      = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.iser_port            = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.iser_target_prefix   = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.nas_host             = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.nas_login            = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.nas_mount_options    = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.nas_password         = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.nas_private_key      = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.nas_share_path       = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.nas_ssh_port         = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.num_shell_tries      = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.nvmet_port_id        = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.replication_device   = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.report_discard_supported = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.reserved_percentage  = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.scst_target_driver   = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.storage_protocol     = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.target_helper        = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.target_ip_address    = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.target_port          = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.target_prefix        = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.target_protocol      = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.trace_flags          = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.use_chap_auth        = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.volume_clear         = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.volume_clear_size    = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] QuobyteHD.volumes_dir          = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack quobyte-client[94464]: Reading configuration file: /etc/quobyte/client.cfg
Aug 12 16:18:47 devstack quobyte-client[94464]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] CMD "mount.quobyte" returned: 1 in 0.083s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.ssl      = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_notifications.driver = [] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_notifications.retry = -1 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] oslo_messaging_notifications.transport_url = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] key_manager.fixed_key          = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican.barbican_api_version  = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican.barbican_endpoint     = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican.barbican_endpoint_type = public {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican.barbican_region_name  = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican.cafile                = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican.certfile              = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican.collect_timing        = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican.insecure              = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican.keyfile               = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican.number_of_retries     = 60 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican.retry_delay           = 1 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican.send_service_user_token = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican.split_loggers         = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican.timeout               = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican.verify_ssl            = True {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican.verify_ssl_path       = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican_service_user.auth_section = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican_service_user.auth_type = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican_service_user.cafile   = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican_service_user.certfile = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican_service_user.collect_timing = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican_service_user.insecure = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican_service_user.keyfile  = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican_service_user.split_loggers = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] barbican_service_user.timeout  = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] vault.approle_role_id          = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] vault.approle_secret_id        = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] vault.auth_method              = approle {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] vault.auth_path                = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] vault.kv_mountpoint            = secret {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] vault.kv_path                  = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] vault.kv_version               = 2 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] vault.namespace                = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] vault.root_token_id            = **** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] vault.ssl_ca_crt_file          = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] vault.timeout                  = 60.0 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] vault.token_file               = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] vault.token_role               = None {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] vault.use_ssl                  = False {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}}
Aug 12 16:18:47 devstack cinder-volume[94167]: DEBUG oslo_service.backend._eventlet.service [None req-40979753-eb48-46b8-a0a7-3402b0afe287 None None] ******************************************************************************** {{(pid=94167) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}}
Aug 12 16:18:47 devstack sudo[94465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:18:47 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:18:47 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.246s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:18:47 devstack cinder-volume[94457]: INFO cinder.volume.driver [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Driver hasn't implemented _init_vendor_properties()
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG cinder.volume.driver [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94457) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG oslo_db.sqlalchemy.engines [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94457) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writer thread running {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG cinder.db.api [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Building query based on filter {{(pid=94457) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=94457) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:18:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:18:47 devstack cinder-volume[94457]: INFO cinder.keymgr.migration [None req-8af30413-ef58-42fa-8434-c812219783b9 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Aug 12 16:18:47 devstack sudo[94478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:18:47 devstack sudo[94478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:18:48 devstack sudo[94478]: pam_unix(sudo:session): session closed for user root
Aug 12 16:18:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.229s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:18:48 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:18:48 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Driver initialization completed successfully.
Aug 12 16:18:48 devstack cinder-volume[94457]: INFO cinder.manager [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Initiating service 3 cleanup
Aug 12 16:18:48 devstack cinder-volume[94457]: INFO cinder.manager [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Service 3 cleanup completed.
Aug 12 16:18:48 devstack cinder-volume[94457]: DEBUG cinder.service [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Creating RPC server for service cinder-volume {{(pid=94457) start /opt/stack/cinder/cinder/service.py:231}}
Aug 12 16:18:48 devstack cinder-volume[94457]: DEBUG cinder.service [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=94457) start /opt/stack/cinder/cinder/service.py:237}}
Aug 12 16:18:48 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2)
Aug 12 16:18:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:18:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:18:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:18:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:18:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:18:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:18:48 devstack sudo[94489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:18:48 devstack sudo[94489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:18:48 devstack sudo[94489]: pam_unix(sudo:session): session closed for user root
Aug 12 16:18:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.240s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:18:48 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-252577e9-d3b8-4cff-988e-a50003bfa1ac None None] Driver post RPC initialization completed successfully.
Aug 12 16:18:57 devstack cinder-volume[94167]: DEBUG dbcounter [-] [94167] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=94167) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:18:58 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:18:58 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=3 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:19:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:19:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 6 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:19:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Flow 'volume_create_manager' (d048decd-b76b-4c10-802b-be14d128a7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae93c8b-1e8e-49e6-8346-ab709aace726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fae93c8b-1e8e-49e6-8346-ab709aace726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1744290534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e99e5aa-110b-467a-82d6-f99956842fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7bd0224dfd94deab7150e42a123a56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:19:57Z,use_quota=True,user_id='38d6b102052e44d6bbb9d86aaef4b63a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1c1dc0-124e-412f-8135-4e4b5f45e1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1c1dc0-124e-412f-8135-4e4b5f45e1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e568475a-f3f1-4b17-9584-9e93c5247439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e568475a-f3f1-4b17-9584-9e93c5247439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e99e5aa-110b-467a-82d6-f99956842fcb', 'volume_name': 'volume-7e99e5aa-110b-467a-82d6-f99956842fcb', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b073b4-3f5f-4091-9a62-74bbbcdd1605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20b073b4-3f5f-4091-9a62-74bbbcdd1605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7c76bb-aadf-48fb-804e-cc7225272d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:19:56 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Volume 7e99e5aa-110b-467a-82d6-f99956842fcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e99e5aa-110b-467a-82d6-f99956842fcb', 'volume_size': 1}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1744290534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e99e5aa-110b-467a-82d6-f99956842fcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7bd0224dfd94deab7150e42a123a56d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:19:57Z,use_quota=True,user_id='38d6b102052e44d6bbb9d86aaef4b63a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Creating volume 7e99e5aa-110b-467a-82d6-f99956842fcb {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:19:56 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:19:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7e99e5aa-110b-467a-82d6-f99956842fcb 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:19:56 devstack sudo[95176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7e99e5aa-110b-467a-82d6-f99956842fcb 1073741824
Aug 12 16:19:56 devstack sudo[95176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:19:58 devstack sudo[95176]: pam_unix(sudo:session): session closed for user root
Aug 12 16:19:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7e99e5aa-110b-467a-82d6-f99956842fcb 1073741824" returned: 0 in 1.278s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:19:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7e99e5aa-110b-467a-82d6-f99956842fcb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:19:58 devstack sudo[95531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7e99e5aa-110b-467a-82d6-f99956842fcb
Aug 12 16:19:58 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:19:58 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root
Aug 12 16:19:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7e99e5aa-110b-467a-82d6-f99956842fcb" returned: 0 in 0.491s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:19:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] <== create_volume: return (1932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:19:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:19:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7c76bb-aadf-48fb-804e-cc7225272d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e99e5aa-110b-467a-82d6-f99956842fcb', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:19:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95410375-0965-4b04-8738-5b684c773805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:19:58 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Volume volume-7e99e5aa-110b-467a-82d6-f99956842fcb (7e99e5aa-110b-467a-82d6-f99956842fcb): created successfully
Aug 12 16:19:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95410375-0965-4b04-8738-5b684c773805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:19:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Flow 'volume_create_manager' (d048decd-b76b-4c10-802b-be14d128a7be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:19:58 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ea4931a4-e880-4d16-9be9-ed040f695ca0 tempest-DeleteServersTestJSON-395681163 None] Created volume successfully.
Aug 12 16:20:03 devstack cinder-volume[94457]: WARNING py.warnings [req-b595ada2-8f4a-4711-ad8c-aa470507f74c req-3ea51ed9-2b5f-4c14-84f6-84d58755751a tempest-DeleteServersTestJSON-395681163 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Aug 12 16:20:03 devstack cinder-volume[94457]:   .first()
Aug 12 16:20:03 devstack cinder-volume[94457]: 
Aug 12 16:20:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-b595ada2-8f4a-4711-ad8c-aa470507f74c req-3ea51ed9-2b5f-4c14-84f6-84d58755751a tempest-DeleteServersTestJSON-395681163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:20:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-b595ada2-8f4a-4711-ad8c-aa470507f74c req-3ea51ed9-2b5f-4c14-84f6-84d58755751a tempest-DeleteServersTestJSON-395681163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:20:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-b595ada2-8f4a-4711-ad8c-aa470507f74c req-3ea51ed9-2b5f-4c14-84f6-84d58755751a tempest-DeleteServersTestJSON-395681163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:20:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-b595ada2-8f4a-4711-ad8c-aa470507f74c req-3ea51ed9-2b5f-4c14-84f6-84d58755751a tempest-DeleteServersTestJSON-395681163 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-7e99e5aa-110b-467a-82d6-f99956842fcb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'faca7906-f50a-4104-8561-89f28cb0db70', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:20:03 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-b595ada2-8f4a-4711-ad8c-aa470507f74c req-3ea51ed9-2b5f-4c14-84f6-84d58755751a tempest-DeleteServersTestJSON-395681163 None] attachment_update completed successfully.
Aug 12 16:20:11 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-4dfa71c4-1406-4e6b-9bf2-bb5ce4056d4c req-995ce62f-0751-44d3-856a-9ee3d7587d3a tempest-DeleteServersTestJSON-395681163 None] Terminate volume connection completed successfully.
Aug 12 16:20:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-4dfa71c4-1406-4e6b-9bf2-bb5ce4056d4c req-995ce62f-0751-44d3-856a-9ee3d7587d3a tempest-DeleteServersTestJSON-395681163 None] Deleting attachment faca7906-f50a-4104-8561-89f28cb0db70. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:20:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Acquiring lock "cinder-7e99e5aa-110b-467a-82d6-f99956842fcb-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:20:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Lock "cinder-7e99e5aa-110b-467a-82d6-f99956842fcb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Acquiring lock "cinder-quobyte-7e99e5aa-110b-467a-82d6-f99956842fcb" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Lock "cinder-quobyte-7e99e5aa-110b-467a-82d6-f99956842fcb" acquired by "delete_volume" :: waited 0.037s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:20:13 devstack cinder-volume[94457]: INFO oslo.privsep.daemon [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpehxywln6/privsep.sock']
Aug 12 16:20:13 devstack sudo[96174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpehxywln6/privsep.sock
Aug 12 16:20:13 devstack sudo[96174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Flow 'volume_create_manager' (bf0a46ae-5875-4c70-866f-c24fa77b8e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b220fb-f953-4840-b0d1-99312e6f9443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b220fb-f953-4840-b0d1-99312e6f9443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-410159321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c2e71c9-36ca-4e7c-98f9-11229f3a5095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c65f851137044922af8d34a97f187be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:20:14Z,use_quota=True,user_id='fecad68b143d4f9798f2dd5365a98b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2594c5f8-a3eb-4a7c-92a5-910c29ea7d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2594c5f8-a3eb-4a7c-92a5-910c29ea7d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a8f04c-676f-4244-930b-98023cb1c091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a8f04c-676f-4244-930b-98023cb1c091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c2e71c9-36ca-4e7c-98f9-11229f3a5095', 'volume_name': 'volume-4c2e71c9-36ca-4e7c-98f9-11229f3a5095', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a40cb56-dedc-4840-985d-e523016b4cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a40cb56-dedc-4840-985d-e523016b4cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfca6e8f-68bc-4d8f-8dff-34df6778cd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:20:13 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Volume 4c2e71c9-36ca-4e7c-98f9-11229f3a5095: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c2e71c9-36ca-4e7c-98f9-11229f3a5095', 'volume_size': 1}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-410159321',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c2e71c9-36ca-4e7c-98f9-11229f3a5095,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c65f851137044922af8d34a97f187be5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:20:14Z,use_quota=True,user_id='fecad68b143d4f9798f2dd5365a98b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Creating volume 4c2e71c9-36ca-4e7c-98f9-11229f3a5095 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:20:13 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:20:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c2e71c9-36ca-4e7c-98f9-11229f3a5095 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:20:13 devstack sudo[96178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c2e71c9-36ca-4e7c-98f9-11229f3a5095 1073741824
Aug 12 16:20:13 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:20:14 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root
Aug 12 16:20:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c2e71c9-36ca-4e7c-98f9-11229f3a5095 1073741824" returned: 0 in 0.502s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:20:14 devstack cinder-volume[94457]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Aug 12 16:20:14 devstack cinder-volume[94457]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Aug 12 16:20:14 devstack cinder-volume[94457]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Aug 12 16:20:14 devstack cinder-volume[94457]: WARNING oslo.privsep.daemon [-] privsep log: 
Aug 12 16:20:14 devstack cinder-volume[94457]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Aug 12 16:20:14 devstack cinder-volume[94457]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Aug 12 16:20:14 devstack cinder-volume[94457]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Aug 12 16:20:14 devstack cinder-volume[94457]: WARNING oslo.privsep.daemon [-] privsep log: 
Aug 12 16:20:14 devstack cinder-volume[94457]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Aug 12 16:20:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c2e71c9-36ca-4e7c-98f9-11229f3a5095 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:20:14 devstack sudo[96185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c2e71c9-36ca-4e7c-98f9-11229f3a5095
Aug 12 16:20:14 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:20:14 devstack sudo[96174]: pam_unix(sudo:session): session closed for user root
Aug 12 16:20:14 devstack cinder-volume[94457]: INFO oslo.privsep.daemon [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Spawned new privsep daemon via rootwrap
Aug 12 16:20:14 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Accepted privsep connection to /tmp/tmpehxywln6/privsep.sock {{(pid=94457) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Aug 12 16:20:14 devstack cinder-volume[94457]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 12 16:20:14 devstack cinder-volume[94457]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 12 16:20:14 devstack cinder-volume[94457]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 12 16:20:14 devstack cinder-volume[94457]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 96184
Aug 12 16:20:14 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ee4e88-88d9-43e6-8bb2-0d20314acced]: (2,) {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:20:14 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32a33dc-96f9-4368-b050-c3bcc30e9daa]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:20:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7e99e5aa-110b-467a-82d6-f99956842fcb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:20:14 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root
Aug 12 16:20:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c2e71c9-36ca-4e7c-98f9-11229f3a5095" returned: 0 in 0.351s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:20:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:20:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:20:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfca6e8f-68bc-4d8f-8dff-34df6778cd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c2e71c9-36ca-4e7c-98f9-11229f3a5095', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:20:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3003188-4861-45a6-81cd-0e38f92fbdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:20:14 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Volume volume-4c2e71c9-36ca-4e7c-98f9-11229f3a5095 (4c2e71c9-36ca-4e7c-98f9-11229f3a5095): created successfully
Aug 12 16:20:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3003188-4861-45a6-81cd-0e38f92fbdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:20:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Flow 'volume_create_manager' (bf0a46ae-5875-4c70-866f-c24fa77b8e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:20:14 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-f12b2ebd-8e3b-461c-92ad-0109ed4f6841 tempest-VolumesAdminNegativeTest-1279644902 None] Created volume successfully.
Aug 12 16:20:14 devstack sudo[96189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7e99e5aa-110b-467a-82d6-f99956842fcb
Aug 12 16:20:14 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:20:15 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root
Aug 12 16:20:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7e99e5aa-110b-467a-82d6-f99956842fcb" returned: 0 in 0.405s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:20:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7e99e5aa-110b-467a-82d6-f99956842fcb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:20:15 devstack sudo[96194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7e99e5aa-110b-467a-82d6-f99956842fcb
Aug 12 16:20:15 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:20:15 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root
Aug 12 16:20:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7e99e5aa-110b-467a-82d6-f99956842fcb" returned: 0 in 0.345s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:20:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Lock "cinder-quobyte-7e99e5aa-110b-467a-82d6-f99956842fcb" released by "delete_volume" :: held 2.357s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:20:15 devstack cinder-volume[94457]: WARNING cinder.quota [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:20:15 devstack cinder-volume[94457]: WARNING cinder.quota [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:20:15 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Created reservations ['2a791cce-1062-4613-b5df-cdc6d4f2e788', '895ab00a-4161-4445-abaf-ecbd47699ce5', '3d324301-19f8-4ab1-af1c-c8260719140a', '576a941e-129a-4873-ba32-2bd6afb3ee9e'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:20:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:20:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:20:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:20:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:20:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:20:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:20:15 devstack sudo[96198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:20:15 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:20:15 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root
Aug 12 16:20:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.273s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:20:15 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:20:15 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Deleted volume successfully.
Aug 12 16:20:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-45d4cf02-882d-4d25-8558-7ae04fc5161f tempest-DeleteServersTestJSON-395681163 None] Lock "cinder-7e99e5aa-110b-467a-82d6-f99956842fcb-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:20:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] Acquiring lock "cinder-4c2e71c9-36ca-4e7c-98f9-11229f3a5095-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:20:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] Lock "cinder-4c2e71c9-36ca-4e7c-98f9-11229f3a5095-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:20:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] Acquiring lock "cinder-quobyte-4c2e71c9-36ca-4e7c-98f9-11229f3a5095" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:20:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] Lock "cinder-quobyte-4c2e71c9-36ca-4e7c-98f9-11229f3a5095" acquired by "delete_volume" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:20:16 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[da984d0f-f7df-44bc-96c9-09c01006b3c4]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:20:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c2e71c9-36ca-4e7c-98f9-11229f3a5095 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:20:16 devstack sudo[96201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c2e71c9-36ca-4e7c-98f9-11229f3a5095
Aug 12 16:20:16 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:20:16 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root
Aug 12 16:20:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c2e71c9-36ca-4e7c-98f9-11229f3a5095" returned: 0 in 0.453s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:20:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c2e71c9-36ca-4e7c-98f9-11229f3a5095 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:20:16 devstack sudo[96206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c2e71c9-36ca-4e7c-98f9-11229f3a5095
Aug 12 16:20:16 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:20:16 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root
Aug 12 16:20:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c2e71c9-36ca-4e7c-98f9-11229f3a5095" returned: 0 in 0.339s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:20:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] Lock "cinder-quobyte-4c2e71c9-36ca-4e7c-98f9-11229f3a5095" released by "delete_volume" :: held 0.840s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:20:17 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] Created reservations ['28caa80e-034a-40c9-a16d-850923ff8254', '6f32ff7c-fab9-44de-afdc-9a432556d3b3', 'a3430a7b-0035-488b-ac02-15fa91a333ae', 'cac13089-b17d-4359-871e-b584b99ddf55'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:20:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:20:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:20:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:20:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:20:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:20:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:20:17 devstack sudo[96209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:20:17 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:20:17 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root
Aug 12 16:20:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.771s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:20:17 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:20:17 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] Deleted volume successfully.
Aug 12 16:20:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6326ee4e-b954-47fb-afec-78f9e0b3a224 tempest-VolumesAdminNegativeTest-1279644902 None] Lock "cinder-4c2e71c9-36ca-4e7c-98f9-11229f3a5095-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:20:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:20:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:20:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:20:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:20:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:20:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:20:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:20:19 devstack sudo[96240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:20:19 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:20:19 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root
Aug 12 16:20:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.318s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:20:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:20:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:20:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 8 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:20:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Flow 'volume_create_manager' (8bfcffd5-d331-4d3b-ba09-fcce25cef50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4961fda9-131c-4f11-9bf3-74102cb36d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4961fda9-131c-4f11-9bf3-74102cb36d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-83517620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdbab769-e86b-49df-a28b-f88185b1ab42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4727be8a28114d61931e43c23090c972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:20:22Z,use_quota=True,user_id='8a5a6efa12e84c408d96d5847f3ff255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8d1824-d2d3-44f9-beb0-a2e210831e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8d1824-d2d3-44f9-beb0-a2e210831e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d96b127-013f-4033-9c4e-e6d650fdcefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d96b127-013f-4033-9c4e-e6d650fdcefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdbab769-e86b-49df-a28b-f88185b1ab42', 'volume_name': 'volume-fdbab769-e86b-49df-a28b-f88185b1ab42', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf8068c-f56f-4970-a099-aaf7b5ee5c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf8068c-f56f-4970-a099-aaf7b5ee5c37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ebb915f-468f-49d6-b94f-548d53bf4296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:20:22 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Volume fdbab769-e86b-49df-a28b-f88185b1ab42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdbab769-e86b-49df-a28b-f88185b1ab42', 'volume_size': 1}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:20:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-83517620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdbab769-e86b-49df-a28b-f88185b1ab42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4727be8a28114d61931e43c23090c972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:20:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:20:22Z,use_quota=True,user_id='8a5a6efa12e84c408d96d5847f3ff255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Creating volume fdbab769-e86b-49df-a28b-f88185b1ab42 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:20:22 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fdbab769-e86b-49df-a28b-f88185b1ab42 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:20:22 devstack sudo[96248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fdbab769-e86b-49df-a28b-f88185b1ab42 1073741824
Aug 12 16:20:22 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:20:22 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fdbab769-e86b-49df-a28b-f88185b1ab42 1073741824" returned: 0 in 0.506s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:20:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fdbab769-e86b-49df-a28b-f88185b1ab42 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:20:22 devstack sudo[96255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fdbab769-e86b-49df-a28b-f88185b1ab42
Aug 12 16:20:22 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:20:23 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root
Aug 12 16:20:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fdbab769-e86b-49df-a28b-f88185b1ab42" returned: 0 in 0.316s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:20:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:20:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:20:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ebb915f-468f-49d6-b94f-548d53bf4296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdbab769-e86b-49df-a28b-f88185b1ab42', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:20:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c240fc-ba8b-451b-80d3-3d048321afb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:20:23 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Volume volume-fdbab769-e86b-49df-a28b-f88185b1ab42 (fdbab769-e86b-49df-a28b-f88185b1ab42): created successfully
Aug 12 16:20:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c240fc-ba8b-451b-80d3-3d048321afb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:20:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Flow 'volume_create_manager' (8bfcffd5-d331-4d3b-ba09-fcce25cef50f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:20:23 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-210bea2d-a5cb-45b2-912e-7d44f7eb753a tempest-ServerActionsTestOtherA-809931543 None] Created volume successfully.
Aug 12 16:20:33 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:UPDATE=29,cinder:SELECT=23,cinder:DELETE=3,cinder:INSERT=1 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:20:33 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=24,cinder:UPDATE=24,cinder:INSERT=10,cinder:DELETE=2 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Flow 'volume_create_manager' (3697b286-f1b7-4ac1-9b20-fd366a4bb6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f11d85-be96-4fe7-ab6e-c6d4f08a6b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f11d85-be96-4fe7-ab6e-c6d4f08a6b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1002995502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf857b16-eeda-4739-add1-35a9841e8d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92ea67e947f84d66ad83e4740cea97d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:20:54Z,use_quota=True,user_id='c772fd6d3af74a57b06b092f20d4dae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c085379-74e1-4c1d-bf33-c47c5585036c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c085379-74e1-4c1d-bf33-c47c5585036c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466671df-422c-4f51-a2a4-0ac3336be063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466671df-422c-4f51-a2a4-0ac3336be063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf857b16-eeda-4739-add1-35a9841e8d9e', 'volume_name': 'volume-cf857b16-eeda-4739-add1-35a9841e8d9e', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cded98-73e6-4bb3-b806-b4afd788ab17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4cded98-73e6-4bb3-b806-b4afd788ab17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2bd1f4-5b7a-4c7d-bbe9-bbb55bcb5a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:20:54 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Volume cf857b16-eeda-4739-add1-35a9841e8d9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf857b16-eeda-4739-add1-35a9841e8d9e', 'volume_size': 1}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1002995502',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf857b16-eeda-4739-add1-35a9841e8d9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92ea67e947f84d66ad83e4740cea97d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:20:54Z,use_quota=True,user_id='c772fd6d3af74a57b06b092f20d4dae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Creating volume cf857b16-eeda-4739-add1-35a9841e8d9e {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:20:54 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:20:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cf857b16-eeda-4739-add1-35a9841e8d9e 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:20:54 devstack sudo[96363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cf857b16-eeda-4739-add1-35a9841e8d9e 1073741824
Aug 12 16:20:54 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:20:55 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root
Aug 12 16:20:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cf857b16-eeda-4739-add1-35a9841e8d9e 1073741824" returned: 0 in 0.740s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:20:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cf857b16-eeda-4739-add1-35a9841e8d9e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:20:55 devstack sudo[96384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cf857b16-eeda-4739-add1-35a9841e8d9e
Aug 12 16:20:55 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:20:55 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root
Aug 12 16:20:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cf857b16-eeda-4739-add1-35a9841e8d9e" returned: 0 in 0.419s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:20:55 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:20:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:20:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2bd1f4-5b7a-4c7d-bbe9-bbb55bcb5a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf857b16-eeda-4739-add1-35a9841e8d9e', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:20:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1808210-2d93-4bc4-b726-2bbfb27a3c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:20:55 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Volume volume-cf857b16-eeda-4739-add1-35a9841e8d9e (cf857b16-eeda-4739-add1-35a9841e8d9e): created successfully
Aug 12 16:20:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1808210-2d93-4bc4-b726-2bbfb27a3c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:20:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Flow 'volume_create_manager' (3697b286-f1b7-4ac1-9b20-fd366a4bb6a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:20:55 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-095b3cc0-3995-434c-b0d6-92d93e21364b tempest-TaggedAttachmentsTest-114204554 None] Created volume successfully.
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Flow 'volume_create_manager' (b6b05cba-b27d-4e3c-a9c9-923e96bb3f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704f3d8e-2533-4e72-816b-d13232d65f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704f3d8e-2533-4e72-816b-d13232d65f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-411347744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='54b12042129e48ceb315f13aca50ca88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:21:01Z,use_quota=True,user_id='b912dc0f3ce04b2b87d7266bd8f3bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4d0031-dfd2-4594-aaa6-98b8db0dfce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4d0031-dfd2-4594-aaa6-98b8db0dfce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e2839e2-d564-47e6-a358-9905f58c9700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e2839e2-d564-47e6-a358-9905f58c9700) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7', 'volume_name': 'volume-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c6a73e-7ded-4542-bec8-39de1ed02969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c6a73e-7ded-4542-bec8-39de1ed02969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8d51d6-ede0-4fca-a598-aa370dfc4571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:01 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Volume 0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7', 'volume_size': 1}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:21:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-411347744',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='54b12042129e48ceb315f13aca50ca88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:21:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:21:01Z,use_quota=True,user_id='b912dc0f3ce04b2b87d7266bd8f3bfb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Creating volume 0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:21:01 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:21:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:01 devstack sudo[96449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7 1073741824
Aug 12 16:21:01 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:02 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7 1073741824" returned: 0 in 0.869s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:02 devstack sudo[96480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7
Aug 12 16:21:02 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:03 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7" returned: 0 in 0.436s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:21:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8d51d6-ede0-4fca-a598-aa370dfc4571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97a8e7a-2ac4-4ff8-87c8-862a26f685a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:03 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Volume volume-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7 (0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7): created successfully
Aug 12 16:21:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d97a8e7a-2ac4-4ff8-87c8-862a26f685a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Flow 'volume_create_manager' (b6b05cba-b27d-4e3c-a9c9-923e96bb3f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:21:03 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-ec0d127f-d87c-48ca-992e-18889d506135 req-c20f317b-d4b3-421e-9f83-f370e9b5406a tempest-VolumesGetTestJSON-478930047 None] Created volume successfully.
Aug 12 16:21:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] Acquiring lock "cinder-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:21:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] Lock "cinder-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:21:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] Acquiring lock "cinder-quobyte-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:21:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] Lock "cinder-quobyte-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7" acquired by "delete_volume" :: waited 0.053s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:21:04 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[2888a2b0-da7c-4c37-8052-fb894f4525b6]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:21:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:04 devstack sudo[96515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7
Aug 12 16:21:04 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:05 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7" returned: 0 in 0.531s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:05 devstack sudo[96521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7
Aug 12 16:21:05 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:05 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7" returned: 0 in 0.433s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] Lock "cinder-quobyte-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7" released by "delete_volume" :: held 1.034s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:21:05 devstack cinder-volume[94457]: DEBUG cinder.quota [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] Created reservations ['2ed27354-3283-4f71-827d-9d1e008a63da', 'fc1de822-d5e9-4e88-a563-1c57ba4ca95a', 'f23f0894-107e-4d96-b06b-09ed5fb37454', '7e71f1c8-5786-4add-9518-cbd38cda5761'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:21:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:21:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:21:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:06 devstack sudo[96526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:21:06 devstack sudo[96526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:06 devstack sudo[96526]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.603s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:06 devstack cinder-volume[94457]: DEBUG cinder.manager [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:21:06 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] Deleted volume successfully.
Aug 12 16:21:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-d8ca0b64-8bb6-456b-8435-e2d3300bf6fe req-5aa94733-4c61-41ec-afc3-e00084c2275d tempest-VolumesGetTestJSON-478930047 None] Lock "cinder-0b8f9f82-d4a7-44c1-a080-cbe84fb1c1f7-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Flow 'volume_create_manager' (2112bc64-367c-47fe-bde5-4c610eb0bd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c122088-df76-431f-af15-fb7686736f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c122088-df76-431f-af15-fb7686736f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1047655573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f36054-b1ea-416a-9780-75430b21bfff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a913078485144d76bff9ddae7efc6e43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:21:14Z,use_quota=True,user_id='321326cdfb654c13929dfdda38ea4433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea0f60c-49c2-412a-a9c9-4502ae108339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bea0f60c-49c2-412a-a9c9-4502ae108339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e63741-dbb2-4145-bf27-896f7e23a2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8e63741-dbb2-4145-bf27-896f7e23a2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44f36054-b1ea-416a-9780-75430b21bfff', 'volume_name': 'volume-44f36054-b1ea-416a-9780-75430b21bfff', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226c8266-59f2-46ba-876f-20f9aaeaebf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (226c8266-59f2-46ba-876f-20f9aaeaebf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32481d06-32fa-4163-ac0c-244587727c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:13 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Volume 44f36054-b1ea-416a-9780-75430b21bfff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44f36054-b1ea-416a-9780-75430b21bfff', 'volume_size': 1}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1047655573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f36054-b1ea-416a-9780-75430b21bfff,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a913078485144d76bff9ddae7efc6e43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:21:14Z,use_quota=True,user_id='321326cdfb654c13929dfdda38ea4433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Creating volume 44f36054-b1ea-416a-9780-75430b21bfff {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:21:13 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:21:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44f36054-b1ea-416a-9780-75430b21bfff 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:14 devstack sudo[96694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44f36054-b1ea-416a-9780-75430b21bfff 1073741824
Aug 12 16:21:14 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:14 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44f36054-b1ea-416a-9780-75430b21bfff 1073741824" returned: 0 in 0.609s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44f36054-b1ea-416a-9780-75430b21bfff {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:14 devstack sudo[96703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44f36054-b1ea-416a-9780-75430b21bfff
Aug 12 16:21:14 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:15 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44f36054-b1ea-416a-9780-75430b21bfff" returned: 0 in 0.472s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:21:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:15 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32481d06-32fa-4163-ac0c-244587727c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44f36054-b1ea-416a-9780-75430b21bfff', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:15 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98bb16a8-286b-42a0-af35-b53ce07bee30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:15 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Volume volume-44f36054-b1ea-416a-9780-75430b21bfff (44f36054-b1ea-416a-9780-75430b21bfff): created successfully
Aug 12 16:21:15 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98bb16a8-286b-42a0-af35-b53ce07bee30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:15 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Flow 'volume_create_manager' (2112bc64-367c-47fe-bde5-4c610eb0bd6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:21:15 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-61fb4b10-3628-4471-85b7-4a95a8a917df tempest-VolumesTestJSON-638868965 None] Created volume successfully.
Aug 12 16:21:16 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:21:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Flow 'volume_create_manager' (33ec249e-138f-412b-8141-b1b9cf47eb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:21:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da00d811-5e68-45c2-a70b-2d31c1bd683a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da00d811-5e68-45c2-a70b-2d31c1bd683a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1280504033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d805ba10-31cc-4f8a-a84d-e9268c024d19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a913078485144d76bff9ddae7efc6e43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:21:17Z,use_quota=True,user_id='321326cdfb654c13929dfdda38ea4433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2030927e-1f79-4f76-bf45-6cf86762585d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2030927e-1f79-4f76-bf45-6cf86762585d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d60365-6469-42b2-9631-c2b88bc984c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53d60365-6469-42b2-9631-c2b88bc984c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd805ba10-31cc-4f8a-a84d-e9268c024d19', 'volume_name': 'volume-d805ba10-31cc-4f8a-a84d-e9268c024d19', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b0954d-f70d-4a20-8ac6-4edc8f545d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b0954d-f70d-4a20-8ac6-4edc8f545d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a10b6fb-aa71-47bc-9472-f90ec794f757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:17 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Volume d805ba10-31cc-4f8a-a84d-e9268c024d19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d805ba10-31cc-4f8a-a84d-e9268c024d19', 'volume_size': 1}
Aug 12 16:21:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:21:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1280504033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d805ba10-31cc-4f8a-a84d-e9268c024d19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a913078485144d76bff9ddae7efc6e43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:21:17Z,use_quota=True,user_id='321326cdfb654c13929dfdda38ea4433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:21:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Creating volume d805ba10-31cc-4f8a-a84d-e9268c024d19 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:21:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:21:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:21:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:21:17 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:21:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d805ba10-31cc-4f8a-a84d-e9268c024d19 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:17 devstack sudo[96706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d805ba10-31cc-4f8a-a84d-e9268c024d19 1073741824
Aug 12 16:21:17 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:17 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d805ba10-31cc-4f8a-a84d-e9268c024d19 1073741824" returned: 0 in 0.752s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d805ba10-31cc-4f8a-a84d-e9268c024d19 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:17 devstack sudo[96711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d805ba10-31cc-4f8a-a84d-e9268c024d19
Aug 12 16:21:17 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:18 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d805ba10-31cc-4f8a-a84d-e9268c024d19" returned: 0 in 0.291s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:21:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a10b6fb-aa71-47bc-9472-f90ec794f757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d805ba10-31cc-4f8a-a84d-e9268c024d19', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5331b29e-dc3a-4d80-80a0-e6dcba711e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:18 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Volume volume-d805ba10-31cc-4f8a-a84d-e9268c024d19 (d805ba10-31cc-4f8a-a84d-e9268c024d19): created successfully
Aug 12 16:21:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5331b29e-dc3a-4d80-80a0-e6dcba711e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Flow 'volume_create_manager' (33ec249e-138f-412b-8141-b1b9cf47eb59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:21:18 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-86758707-0d65-49f5-944c-18c5949e69b5 tempest-VolumesTestJSON-638868965 None] Created volume successfully.
Aug 12 16:21:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:21:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:21:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:21:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:19 devstack sudo[96718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:21:19 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:19 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.424s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:21:19 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:21:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Flow 'volume_create_manager' (d481d27c-070a-40df-bbf0-ee7ded29a4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:21:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13756e8d-59da-498e-b511-5355f865104c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13756e8d-59da-498e-b511-5355f865104c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-317312090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d685afd8-5bc6-43be-8426-1fb09b1d9a2c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a913078485144d76bff9ddae7efc6e43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:21:20Z,use_quota=True,user_id='321326cdfb654c13929dfdda38ea4433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510b25df-5caa-4eea-8935-53448c707fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (510b25df-5caa-4eea-8935-53448c707fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c2fa8f-a328-445e-b040-4bf62e7ef8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c2fa8f-a328-445e-b040-4bf62e7ef8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd685afd8-5bc6-43be-8426-1fb09b1d9a2c', 'volume_name': 'volume-d685afd8-5bc6-43be-8426-1fb09b1d9a2c', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa357b95-88a9-48d4-b437-c7860b845073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa357b95-88a9-48d4-b437-c7860b845073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ceb4afc-9602-428b-a398-a071a3f0150f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:20 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Volume d685afd8-5bc6-43be-8426-1fb09b1d9a2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d685afd8-5bc6-43be-8426-1fb09b1d9a2c', 'volume_size': 1}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-317312090',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d685afd8-5bc6-43be-8426-1fb09b1d9a2c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a913078485144d76bff9ddae7efc6e43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:21:20Z,use_quota=True,user_id='321326cdfb654c13929dfdda38ea4433',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Creating volume d685afd8-5bc6-43be-8426-1fb09b1d9a2c {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:21:20 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d685afd8-5bc6-43be-8426-1fb09b1d9a2c 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:20 devstack sudo[96722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d685afd8-5bc6-43be-8426-1fb09b1d9a2c 1073741824
Aug 12 16:21:20 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:20 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d685afd8-5bc6-43be-8426-1fb09b1d9a2c 1073741824" returned: 0 in 0.524s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d685afd8-5bc6-43be-8426-1fb09b1d9a2c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:20 devstack sudo[96729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d685afd8-5bc6-43be-8426-1fb09b1d9a2c
Aug 12 16:21:20 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:20 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d685afd8-5bc6-43be-8426-1fb09b1d9a2c" returned: 0 in 0.272s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ceb4afc-9602-428b-a398-a071a3f0150f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d685afd8-5bc6-43be-8426-1fb09b1d9a2c', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c84aa5e-efa7-43c3-b19f-c69f90d58157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:20 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Volume volume-d685afd8-5bc6-43be-8426-1fb09b1d9a2c (d685afd8-5bc6-43be-8426-1fb09b1d9a2c): created successfully
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c84aa5e-efa7-43c3-b19f-c69f90d58157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Flow 'volume_create_manager' (d481d27c-070a-40df-bbf0-ee7ded29a4c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:21:20 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-8002325b-fb6f-43bb-9e7e-0920d15f53ea tempest-VolumesTestJSON-638868965 None] Created volume successfully.
Aug 12 16:21:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-88ded061-1cee-423b-af8b-6f7d360c414d req-695bf814-e54d-42a0-90f4-35e9a195ed02 tempest-ServerActionsTestOtherA-809931543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-88ded061-1cee-423b-af8b-6f7d360c414d req-695bf814-e54d-42a0-90f4-35e9a195ed02 tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-88ded061-1cee-423b-af8b-6f7d360c414d req-695bf814-e54d-42a0-90f4-35e9a195ed02 tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-88ded061-1cee-423b-af8b-6f7d360c414d req-695bf814-e54d-42a0-90f4-35e9a195ed02 tempest-ServerActionsTestOtherA-809931543 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-fdbab769-e86b-49df-a28b-f88185b1ab42', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ac0f9d1-151d-4897-85c2-a6d164f1d6ee', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:21:22 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-88ded061-1cee-423b-af8b-6f7d360c414d req-695bf814-e54d-42a0-90f4-35e9a195ed02 tempest-ServerActionsTestOtherA-809931543 None] attachment_update completed successfully.
Aug 12 16:21:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] Acquiring lock "cinder-d685afd8-5bc6-43be-8426-1fb09b1d9a2c-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:21:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] Lock "cinder-d685afd8-5bc6-43be-8426-1fb09b1d9a2c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:21:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] Acquiring lock "cinder-quobyte-d685afd8-5bc6-43be-8426-1fb09b1d9a2c" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:21:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] Lock "cinder-quobyte-d685afd8-5bc6-43be-8426-1fb09b1d9a2c" acquired by "delete_volume" :: waited 0.020s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:21:23 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d285a6-0178-4daa-8358-3ba39f6156a4]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:21:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d685afd8-5bc6-43be-8426-1fb09b1d9a2c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:23 devstack sudo[97156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d685afd8-5bc6-43be-8426-1fb09b1d9a2c
Aug 12 16:21:23 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:23 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d685afd8-5bc6-43be-8426-1fb09b1d9a2c" returned: 0 in 0.394s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d685afd8-5bc6-43be-8426-1fb09b1d9a2c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:23 devstack sudo[97161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d685afd8-5bc6-43be-8426-1fb09b1d9a2c
Aug 12 16:21:23 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:24 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d685afd8-5bc6-43be-8426-1fb09b1d9a2c" returned: 0 in 0.247s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] Lock "cinder-quobyte-d685afd8-5bc6-43be-8426-1fb09b1d9a2c" released by "delete_volume" :: held 0.696s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:21:24 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] Created reservations ['9fc64898-c3ac-40c4-8a00-8cbdc4e0ee84', '249fc4ec-f8e5-4f8b-b9c0-607229c3a0fb', '2ca7198a-86de-4d0d-aac8-b823af0b2156', '56510205-c214-4ff4-bda5-9049e83467e1'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:21:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:21:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:21:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:24 devstack sudo[97164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:21:24 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:24 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.248s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:24 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:21:24 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] Deleted volume successfully.
Aug 12 16:21:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-70425ba7-768b-43bb-a4bb-3c9015b1daaf tempest-VolumesTestJSON-638868965 None] Lock "cinder-d685afd8-5bc6-43be-8426-1fb09b1d9a2c-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:21:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] Acquiring lock "cinder-d805ba10-31cc-4f8a-a84d-e9268c024d19-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:21:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] Lock "cinder-d805ba10-31cc-4f8a-a84d-e9268c024d19-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:21:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] Acquiring lock "cinder-quobyte-d805ba10-31cc-4f8a-a84d-e9268c024d19" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:21:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] Lock "cinder-quobyte-d805ba10-31cc-4f8a-a84d-e9268c024d19" acquired by "delete_volume" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:21:24 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37085d1-d9b7-4228-987a-ff11ca970459]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:21:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d805ba10-31cc-4f8a-a84d-e9268c024d19 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:24 devstack sudo[97167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d805ba10-31cc-4f8a-a84d-e9268c024d19
Aug 12 16:21:24 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:25 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d805ba10-31cc-4f8a-a84d-e9268c024d19" returned: 0 in 0.378s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d805ba10-31cc-4f8a-a84d-e9268c024d19 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:25 devstack sudo[97172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d805ba10-31cc-4f8a-a84d-e9268c024d19
Aug 12 16:21:25 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:25 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d805ba10-31cc-4f8a-a84d-e9268c024d19" returned: 0 in 0.279s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:25 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] Lock "cinder-quobyte-d805ba10-31cc-4f8a-a84d-e9268c024d19" released by "delete_volume" :: held 0.713s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:21:25 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] Created reservations ['ce3b791b-ae4c-49e6-bad9-fbc3534d218b', 'a5dd8441-a668-494a-8a7a-a31b76c5daa8', 'f4c8cf74-414f-44d8-bed0-eaad82edb666', 'cc39e030-9715-4257-a599-09afc4f59e06'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:21:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:21:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:21:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:25 devstack sudo[97178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:21:25 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:25 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] Acquiring lock "cinder-44f36054-b1ea-416a-9780-75430b21bfff-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:21:25 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] Lock "cinder-44f36054-b1ea-416a-9780-75430b21bfff-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:21:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] Acquiring lock "cinder-quobyte-44f36054-b1ea-416a-9780-75430b21bfff" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:21:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] Lock "cinder-quobyte-44f36054-b1ea-416a-9780-75430b21bfff" acquired by "delete_volume" :: waited 0.044s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:21:26 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e640e28-b44e-4d5c-80ac-b72868903459]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:21:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44f36054-b1ea-416a-9780-75430b21bfff {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:26 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.398s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:26 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:21:26 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] Deleted volume successfully.
Aug 12 16:21:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-08169183-117e-4aff-84c3-6d9f215f89af tempest-VolumesTestJSON-638868965 None] Lock "cinder-d805ba10-31cc-4f8a-a84d-e9268c024d19-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:21:26 devstack sudo[97182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44f36054-b1ea-416a-9780-75430b21bfff
Aug 12 16:21:26 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:26 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44f36054-b1ea-416a-9780-75430b21bfff" returned: 0 in 0.400s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44f36054-b1ea-416a-9780-75430b21bfff {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:26 devstack sudo[97195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44f36054-b1ea-416a-9780-75430b21bfff
Aug 12 16:21:26 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:26 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-7d80115c-0137-4dd8-a41f-549d39e7b191 req-a0c7e0ce-f089-4938-8d8b-e07c61f510be tempest-ServerActionsTestOtherA-809931543 None] Terminate volume connection completed successfully.
Aug 12 16:21:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-7d80115c-0137-4dd8-a41f-549d39e7b191 req-a0c7e0ce-f089-4938-8d8b-e07c61f510be tempest-ServerActionsTestOtherA-809931543 None] Deleting attachment 2ac0f9d1-151d-4897-85c2-a6d164f1d6ee. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:21:26 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44f36054-b1ea-416a-9780-75430b21bfff" returned: 0 in 0.281s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] Lock "cinder-quobyte-44f36054-b1ea-416a-9780-75430b21bfff" released by "delete_volume" :: held 0.730s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:21:26 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] Created reservations ['cfbb4240-ac52-4ab8-9e2f-0db50b3d62d9', 'e2eef117-559a-411d-b0be-b0258ea5ee5a', '622636e2-b7f1-4445-8da9-14d8e4c032e9', '66db6d26-1b92-4876-87bc-52fd948d0130'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:21:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:21:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:21:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:26 devstack sudo[97225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:21:26 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:27 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.428s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:27 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:21:27 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] Deleted volume successfully.
Aug 12 16:21:27 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c3e84cef-184c-4734-95ac-b54b14473888 tempest-VolumesTestJSON-638868965 None] Lock "cinder-44f36054-b1ea-416a-9780-75430b21bfff-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:21:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-7d80115c-0137-4dd8-a41f-549d39e7b191 req-c157d804-aedd-4066-a711-1a4cd57eb9cc tempest-ServerActionsTestOtherA-809931543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-7d80115c-0137-4dd8-a41f-549d39e7b191 req-c157d804-aedd-4066-a711-1a4cd57eb9cc tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-7d80115c-0137-4dd8-a41f-549d39e7b191 req-c157d804-aedd-4066-a711-1a4cd57eb9cc tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-7d80115c-0137-4dd8-a41f-549d39e7b191 req-c157d804-aedd-4066-a711-1a4cd57eb9cc tempest-ServerActionsTestOtherA-809931543 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-fdbab769-e86b-49df-a28b-f88185b1ab42', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b765cc5-8b11-4da4-909f-36c38f79e023', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:21:28 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-7d80115c-0137-4dd8-a41f-549d39e7b191 req-c157d804-aedd-4066-a711-1a4cd57eb9cc tempest-ServerActionsTestOtherA-809931543 None] attachment_update completed successfully.
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Flow 'volume_create_manager' (1c1e7de7-46dd-49d1-9a78-33512d5345d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d926a3-de89-46f8-9db2-65b86085e30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d926a3-de89-46f8-9db2-65b86085e30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-652619311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b64128f-927b-4686-8f7a-7ca4a64d5584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53dbfc5be91400f8845219d3b02c012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:21:32Z,use_quota=True,user_id='7f7fbf05f3344a32a44a433c20e5bb0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2bf83f-4d9f-4fb6-b00b-697c28c7b47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2bf83f-4d9f-4fb6-b00b-697c28c7b47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65440836-1c2c-402f-99fc-fe8de337a4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65440836-1c2c-402f-99fc-fe8de337a4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b64128f-927b-4686-8f7a-7ca4a64d5584', 'volume_name': 'volume-6b64128f-927b-4686-8f7a-7ca4a64d5584', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bcacba6-312c-4e16-a0fe-5a4e3728cac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bcacba6-312c-4e16-a0fe-5a4e3728cac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (092e5c95-36c6-4d98-ac3b-057700933235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:31 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Volume 6b64128f-927b-4686-8f7a-7ca4a64d5584: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b64128f-927b-4686-8f7a-7ca4a64d5584', 'volume_size': 1}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-652619311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b64128f-927b-4686-8f7a-7ca4a64d5584,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d53dbfc5be91400f8845219d3b02c012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:21:32Z,use_quota=True,user_id='7f7fbf05f3344a32a44a433c20e5bb0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Creating volume 6b64128f-927b-4686-8f7a-7ca4a64d5584 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:21:31 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:21:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6b64128f-927b-4686-8f7a-7ca4a64d5584 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:31 devstack sudo[97736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6b64128f-927b-4686-8f7a-7ca4a64d5584 1073741824
Aug 12 16:21:31 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:32 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6b64128f-927b-4686-8f7a-7ca4a64d5584 1073741824" returned: 0 in 0.506s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6b64128f-927b-4686-8f7a-7ca4a64d5584 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:32 devstack sudo[97751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6b64128f-927b-4686-8f7a-7ca4a64d5584
Aug 12 16:21:32 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:32 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6b64128f-927b-4686-8f7a-7ca4a64d5584" returned: 0 in 0.273s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:21:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (092e5c95-36c6-4d98-ac3b-057700933235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b64128f-927b-4686-8f7a-7ca4a64d5584', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ecc7d5-d1da-4edd-a544-b0706f2fe785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:32 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Volume volume-6b64128f-927b-4686-8f7a-7ca4a64d5584 (6b64128f-927b-4686-8f7a-7ca4a64d5584): created successfully
Aug 12 16:21:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ecc7d5-d1da-4edd-a544-b0706f2fe785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Flow 'volume_create_manager' (1c1e7de7-46dd-49d1-9a78-33512d5345d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:21:32 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-16084efe-60b5-49b4-8be4-c9a7616f23dd tempest-AttachVolumeShelveTestJSON-9930265 None] Created volume successfully.
Aug 12 16:21:33 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5f34f962-9f52-4791-ace1-6618780ecd85 tempest-GroupSnapshotsV319Test-878657249 None] Group tempest-GroupSnapshotsV319Test-Group-539312136: creating
Aug 12 16:21:33 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5f34f962-9f52-4791-ace1-6618780ecd85 tempest-GroupSnapshotsV319Test-878657249 None] Group tempest-GroupSnapshotsV319Test-Group-539312136: created successfully
Aug 12 16:21:33 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5f34f962-9f52-4791-ace1-6618780ecd85 tempest-GroupSnapshotsV319Test-878657249 None] Create group completed successfully.
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Flow 'volume_create_manager' (7ea13541-1141-4ad5-b1f5-6545826cbe48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd69a3f-c3d5-4a11-8dee-43960d052d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd69a3f-c3d5-4a11-8dee-43960d052d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1461739319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fcc74857-14be-4d6a-b4ac-531902d1cada,host='devstack@QuobyteHD#QuobyteHD',id=bb4ce217-2600-49cc-9894-a523648afb29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e31ad97fa874c98884e980d4b0368f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:21:35Z,use_quota=True,user_id='6be4b69c5268420bb590fbed675a7e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1b832a1-ac69-4ab1-b814-11e6809a46cf),volume_type_id=c1b832a1-ac69-4ab1-b814-11e6809a46cf)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18770e67-117c-43f8-b428-97472ef7c4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18770e67-117c-43f8-b428-97472ef7c4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6c10ce-684a-4dfb-9437-bb5e02d59bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6c10ce-684a-4dfb-9437-bb5e02d59bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb4ce217-2600-49cc-9894-a523648afb29', 'volume_name': 'volume-bb4ce217-2600-49cc-9894-a523648afb29', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83799158-b00d-461a-86c1-beb4d0f5b51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83799158-b00d-461a-86c1-beb4d0f5b51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b39d11-65aa-422c-b91d-2a3021d8ec87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:35 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Volume bb4ce217-2600-49cc-9894-a523648afb29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb4ce217-2600-49cc-9894-a523648afb29', 'volume_size': 1}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=fcc74857-14be-4d6a-b4ac-531902d1cada,created_at=2026-08-12T14:21:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1461739319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fcc74857-14be-4d6a-b4ac-531902d1cada,host='devstack@QuobyteHD#QuobyteHD',id=bb4ce217-2600-49cc-9894-a523648afb29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e31ad97fa874c98884e980d4b0368f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:21:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:21:35Z,use_quota=True,user_id='6be4b69c5268420bb590fbed675a7e14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1b832a1-ac69-4ab1-b814-11e6809a46cf),volume_type_id=c1b832a1-ac69-4ab1-b814-11e6809a46cf)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Creating volume bb4ce217-2600-49cc-9894-a523648afb29 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:21:35 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:35 devstack sudo[97760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29 1073741824
Aug 12 16:21:35 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:35 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29 1073741824" returned: 0 in 0.604s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:35 devstack sudo[97776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29
Aug 12 16:21:35 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:36 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29" returned: 0 in 0.260s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:21:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b39d11-65aa-422c-b91d-2a3021d8ec87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb4ce217-2600-49cc-9894-a523648afb29', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b8d104-5397-4261-b81c-0f5ce7f96fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:21:36 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Volume volume-bb4ce217-2600-49cc-9894-a523648afb29 (bb4ce217-2600-49cc-9894-a523648afb29): created successfully
Aug 12 16:21:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b8d104-5397-4261-b81c-0f5ce7f96fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:21:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Flow 'volume_create_manager' (7ea13541-1141-4ad5-b1f5-6545826cbe48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:21:36 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-4e29cf19-13bf-422f-9c4e-02c5be690001 tempest-GroupSnapshotsV319Test-878657249 None] Created volume successfully.
Aug 12 16:21:37 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] GroupSnapshot 04011919-9614-4743-a250-24a848cb2ecd: creating.
Aug 12 16:21:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] Group snapshot 04011919-9614-4743-a250-24a848cb2ecd: creating. {{(pid=94457) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 12 16:21:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] Creating offline snapshot 8c07e8b1-61af-49f0-ab4d-244b2628a244 of volume bb4ce217-2600-49cc-9894-a523648afb29 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:21:38 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4ffd31-7b08-4a7c-aecc-4913d636bac4]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:21:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:38 devstack sudo[97788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29
Aug 12 16:21:38 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:38 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29" returned: 0 in 0.504s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:38 devstack sudo[97793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244 1G
Aug 12 16:21:38 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:39 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244 1G" returned: 0 in 0.609s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb4ce217-2600-49cc-9894-a523648afb29 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:39 devstack sudo[97801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb4ce217-2600-49cc-9894-a523648afb29 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244
Aug 12 16:21:39 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:39 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb4ce217-2600-49cc-9894-a523648afb29 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244" returned: 0 in 0.476s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:39 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244 is being set with open permissions: ugo+rw: NotImplementedError
Aug 12 16:21:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:39 devstack sudo[97807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244
Aug 12 16:21:39 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:39 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244" returned: 0 in 0.367s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:40 devstack sudo[97810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.info
Aug 12 16:21:40 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:40 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.info" returned: 0 in 0.436s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:40 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 12 16:21:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:40 devstack sudo[97815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.info
Aug 12 16:21:40 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:40 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.info" returned: 0 in 0.307s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.830s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:40 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-44f10c57-40e4-46db-8b1f-c9ae9d54b7fc tempest-GroupSnapshotsV319Test-878657249 None] group_snapshot 04011919-9614-4743-a250-24a848cb2ecd: created successfully
Aug 12 16:21:41 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] group_snapshot 04011919-9614-4743-a250-24a848cb2ecd: deleting
Aug 12 16:21:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] group_snapshot 04011919-9614-4743-a250-24a848cb2ecd: deleting {{(pid=94457) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 12 16:21:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] Acquiring lock "cinder-quobyte-bb4ce217-2600-49cc-9894-a523648afb29" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:21:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] Lock "cinder-quobyte-bb4ce217-2600-49cc-9894-a523648afb29" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:21:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] Acquiring lock "cinder-quobyte-8c07e8b1-61af-49f0-ab4d-244b2628a244" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:21:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] Lock "cinder-quobyte-8c07e8b1-61af-49f0-ab4d-244b2628a244" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:21:41 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] Deleting offline snapshot 8c07e8b1-61af-49f0-ab4d-244b2628a244 of volume bb4ce217-2600-49cc-9894-a523648afb29 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:21:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] snapshot_file for this snap is: volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:21:42 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc00f57e-c5e0-4713-97d1-791783de089b]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:21:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:42 devstack sudo[97821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244
Aug 12 16:21:42 devstack sudo[97821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:42 devstack sudo[97821]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244" returned: 0 in 0.607s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb4ce217-2600-49cc-9894-a523648afb29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:21:42 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91b20f9-f3d8-4ced-b426-b04c8dace7bc]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:21:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:43 devstack sudo[97830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29
Aug 12 16:21:43 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:43 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29" returned: 0 in 0.971s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:43 devstack sudo[97879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244
Aug 12 16:21:43 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:44 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244" returned: 0 in 0.709s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:44 devstack sudo[97895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244
Aug 12 16:21:44 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:44 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29.8c07e8b1-61af-49f0-ab4d-244b2628a244" returned: 0 in 0.515s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] Lock "cinder-quobyte-8c07e8b1-61af-49f0-ab4d-244b2628a244" released by "_delete_snapshot" :: held 2.993s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:21:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] Lock "cinder-quobyte-bb4ce217-2600-49cc-9894-a523648afb29" released by "delete_snapshot" :: held 3.061s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:21:45 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=61,cinder:INSERT=14,cinder:UPDATE=52,cinder:DELETE=3 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:21:45 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:UPDATE=68,cinder:SELECT=55,cinder:DELETE=8,cinder:INSERT=10 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:21:45 devstack cinder-volume[94457]: WARNING cinder.quota [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1034845589 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1034845589, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:21:45 devstack cinder-volume[94457]: WARNING cinder.quota [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1034845589 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1034845589, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:21:45 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] Created reservations ['f1d5625f-b919-4a80-af05-0916a01611d1', '4019cca8-8d51-4eb8-b3b5-276880774a89', 'aa8ca7bc-15e6-48e4-980f-cb999b1e2da5', 'ce747f23-67cf-4703-8642-e3d797d7f20b'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:21:45 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-3556dd71-7c22-4f4a-997f-21ab489b2880 tempest-GroupSnapshotsV319Test-878657249 None] group_snapshot 04011919-9614-4743-a250-24a848cb2ecd: deleted successfully
Aug 12 16:21:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1cbde4e5-c235-4051-ae32-8afef2dd99d4 tempest-GroupSnapshotsV319Test-878657249 None] Acquiring lock "cinder-quobyte-bb4ce217-2600-49cc-9894-a523648afb29" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:21:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1cbde4e5-c235-4051-ae32-8afef2dd99d4 tempest-GroupSnapshotsV319Test-878657249 None] Lock "cinder-quobyte-bb4ce217-2600-49cc-9894-a523648afb29" acquired by "delete_volume" :: waited 0.029s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:21:46 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fab6ac-9fbe-4aea-9b47-5062cf852017]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:21:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1cbde4e5-c235-4051-ae32-8afef2dd99d4 tempest-GroupSnapshotsV319Test-878657249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-c7191256-6526-46e7-8dd9-67ce015d67dd req-a7b41b41-e7a6-41e9-b834-666f8d0ff29e tempest-AttachVolumeShelveTestJSON-9930265 None] No connector for attachment 4b77c2ee-4e6a-49f0-a120-05eef162836f; skipping storage backend terminate_connection call. {{(pid=94457) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Aug 12 16:21:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-c7191256-6526-46e7-8dd9-67ce015d67dd req-a7b41b41-e7a6-41e9-b834-666f8d0ff29e tempest-AttachVolumeShelveTestJSON-9930265 None] Deleting attachment 4b77c2ee-4e6a-49f0-a120-05eef162836f. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:21:46 devstack sudo[97963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29
Aug 12 16:21:46 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-382a0006-6fe9-4ef5-9939-b3991a330788 req-e89c2a14-cd00-42d8-9033-5206ce5f12e0 tempest-TaggedAttachmentsTest-114204554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-382a0006-6fe9-4ef5-9939-b3991a330788 req-e89c2a14-cd00-42d8-9033-5206ce5f12e0 tempest-TaggedAttachmentsTest-114204554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-382a0006-6fe9-4ef5-9939-b3991a330788 req-e89c2a14-cd00-42d8-9033-5206ce5f12e0 tempest-TaggedAttachmentsTest-114204554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-382a0006-6fe9-4ef5-9939-b3991a330788 req-e89c2a14-cd00-42d8-9033-5206ce5f12e0 tempest-TaggedAttachmentsTest-114204554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-cf857b16-eeda-4739-add1-35a9841e8d9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '19bf812d-0837-491c-8671-e24af001eba7', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:21:46 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-382a0006-6fe9-4ef5-9939-b3991a330788 req-e89c2a14-cd00-42d8-9033-5206ce5f12e0 tempest-TaggedAttachmentsTest-114204554 None] attachment_update completed successfully.
Aug 12 16:21:46 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1cbde4e5-c235-4051-ae32-8afef2dd99d4 tempest-GroupSnapshotsV319Test-878657249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29" returned: 0 in 0.541s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1cbde4e5-c235-4051-ae32-8afef2dd99d4 tempest-GroupSnapshotsV319Test-878657249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:46 devstack sudo[97985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29
Aug 12 16:21:46 devstack sudo[97985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:47 devstack sudo[97985]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1cbde4e5-c235-4051-ae32-8afef2dd99d4 tempest-GroupSnapshotsV319Test-878657249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb4ce217-2600-49cc-9894-a523648afb29" returned: 0 in 0.428s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:47 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1cbde4e5-c235-4051-ae32-8afef2dd99d4 tempest-GroupSnapshotsV319Test-878657249 None] Lock "cinder-quobyte-bb4ce217-2600-49cc-9894-a523648afb29" released by "delete_volume" :: held 1.067s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:21:47 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-1cbde4e5-c235-4051-ae32-8afef2dd99d4 tempest-GroupSnapshotsV319Test-878657249 None] Created reservations ['be37f941-58ee-4cf2-a857-e5d09cb7ec4b'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:21:47 devstack cinder-volume[94457]: WARNING cinder.quota [None req-1cbde4e5-c235-4051-ae32-8afef2dd99d4 tempest-GroupSnapshotsV319Test-878657249 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1034845589 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1034845589, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:21:47 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-1cbde4e5-c235-4051-ae32-8afef2dd99d4 tempest-GroupSnapshotsV319Test-878657249 None] Created reservations ['0698ea4c-27f4-48cf-a9af-00939e71a4bd', '094e7e47-b404-46ac-95d7-d8676d329ec7', '588bc827-30af-4065-9b6d-2ff943ffddd1', '04d85337-0f94-4899-88cc-8e2a5d70c482'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:21:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1cbde4e5-c235-4051-ae32-8afef2dd99d4 tempest-GroupSnapshotsV319Test-878657249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:21:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1cbde4e5-c235-4051-ae32-8afef2dd99d4 tempest-GroupSnapshotsV319Test-878657249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:21:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1cbde4e5-c235-4051-ae32-8afef2dd99d4 tempest-GroupSnapshotsV319Test-878657249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:21:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1cbde4e5-c235-4051-ae32-8afef2dd99d4 tempest-GroupSnapshotsV319Test-878657249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:21:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1cbde4e5-c235-4051-ae32-8afef2dd99d4 tempest-GroupSnapshotsV319Test-878657249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:21:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1cbde4e5-c235-4051-ae32-8afef2dd99d4 tempest-GroupSnapshotsV319Test-878657249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:21:47 devstack sudo[97989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:21:47 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:21:47 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root
Aug 12 16:21:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1cbde4e5-c235-4051-ae32-8afef2dd99d4 tempest-GroupSnapshotsV319Test-878657249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.263s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:21:47 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-1cbde4e5-c235-4051-ae32-8afef2dd99d4 tempest-GroupSnapshotsV319Test-878657249 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:21:47 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-1cbde4e5-c235-4051-ae32-8afef2dd99d4 tempest-GroupSnapshotsV319Test-878657249 None] Delete group completed successfully.
Aug 12 16:21:49 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-75c62bbe-7505-47f3-8ccf-9ab99c9db165 req-907c8b3d-73be-4b4c-b1ce-ddbb78c9cd2d tempest-TaggedAttachmentsTest-114204554 None] Terminate volume connection completed successfully.
Aug 12 16:21:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-75c62bbe-7505-47f3-8ccf-9ab99c9db165 req-907c8b3d-73be-4b4c-b1ce-ddbb78c9cd2d tempest-TaggedAttachmentsTest-114204554 None] Deleting attachment 19bf812d-0837-491c-8671-e24af001eba7. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:21:56 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5bb40804-b36b-4a93-98fc-a726b2b4c0c5 tempest-GroupsTest-1973047448 None] Group tempest-Group1-748778801: creating
Aug 12 16:21:56 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5bb40804-b36b-4a93-98fc-a726b2b4c0c5 tempest-GroupsTest-1973047448 None] Group tempest-Group1-748778801: created successfully
Aug 12 16:21:56 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5bb40804-b36b-4a93-98fc-a726b2b4c0c5 tempest-GroupsTest-1973047448 None] Create group completed successfully.
Aug 12 16:21:58 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-01e68e4e-d4cd-4124-b769-121609d981b0 tempest-GroupsTest-1973047448 None] Group tempest-Group2-315468318: creating
Aug 12 16:21:58 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-01e68e4e-d4cd-4124-b769-121609d981b0 tempest-GroupsTest-1973047448 None] Group tempest-Group2-315468318: created successfully
Aug 12 16:21:58 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-01e68e4e-d4cd-4124-b769-121609d981b0 tempest-GroupsTest-1973047448 None] Create group completed successfully.
Aug 12 16:21:59 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-dc546690-8771-4e29-b44f-1cc36229862a req-4e73a052-e640-461a-8838-75461e067a8d tempest-ServerActionsTestOtherA-809931543 None] Terminate volume connection completed successfully.
Aug 12 16:21:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-dc546690-8771-4e29-b44f-1cc36229862a req-4e73a052-e640-461a-8838-75461e067a8d tempest-ServerActionsTestOtherA-809931543 None] Deleting attachment 2b765cc5-8b11-4da4-909f-36c38f79e023. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Flow 'volume_create_manager' (ca8ab7ea-e095-4d9c-a856-4cef9366ed6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f796bd84-890c-4244-91cd-34508043085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f796bd84-890c-4244-91cd-34508043085e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-965616564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1aab9ee1-e258-4ba9-bffc-44794ee0e816,host='devstack@QuobyteHD#QuobyteHD',id=90ae9dc8-e686-406d-a4d7-192eb1e5ec25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e299778d192841bd940fcaab2f1a2b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:22:00Z,use_quota=True,user_id='e8a6e4d406f64733be2bfa53173212d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25b3fd2b-bd89-484f-8635-b471f9d3c4ca),volume_type_id=25b3fd2b-bd89-484f-8635-b471f9d3c4ca)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed9728f-580a-483c-8766-5ce39aec8841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ed9728f-580a-483c-8766-5ce39aec8841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece1236e-cfe4-47d0-abdb-5b2b595ba72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece1236e-cfe4-47d0-abdb-5b2b595ba72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90ae9dc8-e686-406d-a4d7-192eb1e5ec25', 'volume_name': 'volume-90ae9dc8-e686-406d-a4d7-192eb1e5ec25', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0835d08a-dfca-4772-aab4-76c838163465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0835d08a-dfca-4772-aab4-76c838163465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb39ff00-f4c9-4b33-a86f-607640254f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:00 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Volume 90ae9dc8-e686-406d-a4d7-192eb1e5ec25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90ae9dc8-e686-406d-a4d7-192eb1e5ec25', 'volume_size': 1}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1aab9ee1-e258-4ba9-bffc-44794ee0e816,created_at=2026-08-12T14:22:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-965616564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1aab9ee1-e258-4ba9-bffc-44794ee0e816,host='devstack@QuobyteHD#QuobyteHD',id=90ae9dc8-e686-406d-a4d7-192eb1e5ec25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e299778d192841bd940fcaab2f1a2b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:22:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:22:00Z,use_quota=True,user_id='e8a6e4d406f64733be2bfa53173212d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25b3fd2b-bd89-484f-8635-b471f9d3c4ca),volume_type_id=25b3fd2b-bd89-484f-8635-b471f9d3c4ca)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Creating volume 90ae9dc8-e686-406d-a4d7-192eb1e5ec25 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:22:00 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:22:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-90ae9dc8-e686-406d-a4d7-192eb1e5ec25 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:00 devstack sudo[98208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-90ae9dc8-e686-406d-a4d7-192eb1e5ec25 1073741824
Aug 12 16:22:00 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:01 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-90ae9dc8-e686-406d-a4d7-192eb1e5ec25 1073741824" returned: 0 in 0.710s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-90ae9dc8-e686-406d-a4d7-192eb1e5ec25 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:01 devstack sudo[98250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-90ae9dc8-e686-406d-a4d7-192eb1e5ec25
Aug 12 16:22:01 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:01 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-90ae9dc8-e686-406d-a4d7-192eb1e5ec25" returned: 0 in 0.402s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:22:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:22:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb39ff00-f4c9-4b33-a86f-607640254f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90ae9dc8-e686-406d-a4d7-192eb1e5ec25', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdcb9de1-2cb9-4ec3-8b22-178290af4a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:01 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Volume volume-90ae9dc8-e686-406d-a4d7-192eb1e5ec25 (90ae9dc8-e686-406d-a4d7-192eb1e5ec25): created successfully
Aug 12 16:22:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdcb9de1-2cb9-4ec3-8b22-178290af4a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Flow 'volume_create_manager' (ca8ab7ea-e095-4d9c-a856-4cef9366ed6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:22:01 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-bffb15c7-e31a-45b7-ab27-3e47c37c809c tempest-GroupsTest-1973047448 None] Created volume successfully.
Aug 12 16:22:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] Acquiring lock "cinder-quobyte-90ae9dc8-e686-406d-a4d7-192eb1e5ec25" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:22:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] Lock "cinder-quobyte-90ae9dc8-e686-406d-a4d7-192eb1e5ec25" acquired by "delete_volume" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:22:03 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7a2904-a1b5-4930-b30b-8a8ece89607a]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:22:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-90ae9dc8-e686-406d-a4d7-192eb1e5ec25 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:04 devstack sudo[98265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-90ae9dc8-e686-406d-a4d7-192eb1e5ec25
Aug 12 16:22:04 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:04 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-90ae9dc8-e686-406d-a4d7-192eb1e5ec25" returned: 0 in 0.573s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-90ae9dc8-e686-406d-a4d7-192eb1e5ec25 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] Acquiring lock "cinder-cf857b16-eeda-4739-add1-35a9841e8d9e-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:22:04 devstack sudo[98270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-90ae9dc8-e686-406d-a4d7-192eb1e5ec25
Aug 12 16:22:04 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] Lock "cinder-cf857b16-eeda-4739-add1-35a9841e8d9e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:22:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] Acquiring lock "cinder-quobyte-cf857b16-eeda-4739-add1-35a9841e8d9e" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:22:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] Lock "cinder-quobyte-cf857b16-eeda-4739-add1-35a9841e8d9e" acquired by "delete_volume" :: waited 0.019s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:22:04 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b88d1e-bbb7-4e95-89f6-41afc84ad49b]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:22:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cf857b16-eeda-4739-add1-35a9841e8d9e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:04 devstack sudo[98272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cf857b16-eeda-4739-add1-35a9841e8d9e
Aug 12 16:22:04 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:04 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-90ae9dc8-e686-406d-a4d7-192eb1e5ec25" returned: 0 in 0.402s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] Lock "cinder-quobyte-90ae9dc8-e686-406d-a4d7-192eb1e5ec25" released by "delete_volume" :: held 1.049s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] Created reservations ['02eac288-21ad-48da-a25a-92650406264e'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:22:05 devstack cinder-volume[94457]: WARNING cinder.quota [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1865671904 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1865671904, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:22:05 devstack cinder-volume[94457]: WARNING cinder.quota [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1865671904 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1865671904, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] Created reservations ['3ecbc049-eae6-4fc9-a4db-e6102d3ae36f', 'c0e7fb51-b742-4ac2-b14f-6de517ede04c', '7200ab91-7b0a-465a-aa21-ebd22bc536be', 'ca4a4fc8-995c-47ef-898c-09d80fedace3'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:22:05 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cf857b16-eeda-4739-add1-35a9841e8d9e" returned: 0 in 0.540s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cf857b16-eeda-4739-add1-35a9841e8d9e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:22:05 devstack sudo[98278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cf857b16-eeda-4739-add1-35a9841e8d9e
Aug 12 16:22:05 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:05 devstack sudo[98280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:22:05 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:05 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cf857b16-eeda-4739-add1-35a9841e8d9e" returned: 0 in 0.318s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:05 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.281s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] Lock "cinder-quobyte-cf857b16-eeda-4739-add1-35a9841e8d9e" released by "delete_volume" :: held 0.921s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:22:05 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-83163701-269f-4340-9fbf-404c808d6b7f tempest-GroupsTest-1973047448 None] Delete group completed successfully.
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] Created reservations ['589e4bbb-b1c5-4a61-8e63-a8bf9bcb1ad3', '6dd5a16c-1fbd-4381-ae43-b610bab4fc31', '509a49ee-310a-4595-84d2-8c0288993f5c', '8f800298-7978-4c98-9026-e51101099ca4'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:22:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:05 devstack sudo[98284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:22:05 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:06 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.320s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:06 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:22:06 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] Deleted volume successfully.
Aug 12 16:22:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8af844f3-8f64-476f-b879-b7ad52e69821 tempest-TaggedAttachmentsTest-114204554 None] Lock "cinder-cf857b16-eeda-4739-add1-35a9841e8d9e-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:22:06 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-eeb081da-cff6-4fc7-a609-fa770cba2059 tempest-GroupsTest-1973047448 None] Created reservations ['8d6ff64c-234c-4b0a-a39d-7020bb2e69ec'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:22:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-eeb081da-cff6-4fc7-a609-fa770cba2059 tempest-GroupsTest-1973047448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:22:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-eeb081da-cff6-4fc7-a609-fa770cba2059 tempest-GroupsTest-1973047448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:22:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-eeb081da-cff6-4fc7-a609-fa770cba2059 tempest-GroupsTest-1973047448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:22:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-eeb081da-cff6-4fc7-a609-fa770cba2059 tempest-GroupsTest-1973047448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:22:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-eeb081da-cff6-4fc7-a609-fa770cba2059 tempest-GroupsTest-1973047448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:22:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-eeb081da-cff6-4fc7-a609-fa770cba2059 tempest-GroupsTest-1973047448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:06 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:22:06 devstack sudo[98288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:22:06 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Flow 'volume_create_manager' (0d6df24e-a45d-42bd-ab93-feddd31c2f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:22:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d69e8c75-370c-4d73-8188-e824e80913de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d69e8c75-370c-4d73-8188-e824e80913de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1141149261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8940490f-a6f8-4ec4-af08-5636f21161eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4727be8a28114d61931e43c23090c972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:22:07Z,use_quota=True,user_id='8a5a6efa12e84c408d96d5847f3ff255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0a3e49-de99-45ca-84f2-e23d0b432b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0a3e49-de99-45ca-84f2-e23d0b432b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c297dcb-6baa-4090-b493-bf5bfbaba921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:06 devstack cinder-volume[94457]: DEBUG cinder.image.glance [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Creating Keystone auth plugin from conf {{(pid=94457) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 12 16:22:07 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-eeb081da-cff6-4fc7-a609-fa770cba2059 tempest-GroupsTest-1973047448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.311s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:07 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-eeb081da-cff6-4fc7-a609-fa770cba2059 tempest-GroupsTest-1973047448 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:22:07 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-eeb081da-cff6-4fc7-a609-fa770cba2059 tempest-GroupsTest-1973047448 None] Delete group completed successfully.
Aug 12 16:22:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c297dcb-6baa-4090-b493-bf5bfbaba921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8940490f-a6f8-4ec4-af08-5636f21161eb', 'volume_name': 'volume-8940490f-a6f8-4ec4-af08-5636f21161eb', 'volume_size': 1, 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b7d6f6e2f82493fb2262e877eaef313', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'created_at': datetime.datetime(2026, 8, 12, 14, 14, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 14, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86433006-753f-43b5-b60e-7f6f6c1c77c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b63cd3170>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22bcfbd-d197-4234-a6e6-1491679f37c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22bcfbd-d197-4234-a6e6-1491679f37c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d8fbc1-cdd3-490a-86a1-8b77a05221c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:07 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Volume 8940490f-a6f8-4ec4-af08-5636f21161eb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8940490f-a6f8-4ec4-af08-5636f21161eb', 'volume_size': 1, 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b7d6f6e2f82493fb2262e877eaef313', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'created_at': datetime.datetime(2026, 8, 12, 14, 14, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 14, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86433006-753f-43b5-b60e-7f6f6c1c77c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b63cd3170>}
Aug 12 16:22:07 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Trying to clone 8940490f-a6f8-4ec4-af08-5636f21161eb from image 86433006-753f-43b5-b60e-7f6f6c1c77c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]). {{(pid=94457) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 12 16:22:07 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_ldf5fjr3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 12 16:22:07 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Image download 20.69 MB at 20.69 MB/s
Aug 12 16:22:07 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf6e6f0-6b95-41d3-b4a5-c8ed097e75a1]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:22:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_ldf5fjr3devstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:08 devstack sudo[98313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_ldf5fjr3devstack@QuobyteHD
Aug 12 16:22:08 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:08 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a5d1328e-ba88-4281-aeb6-f9824c400b76 tempest-GroupsTest-1973047448 None] Group tempest-GroupsTest-Group-873050643: creating
Aug 12 16:22:08 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_ldf5fjr3devstack@QuobyteHD" returned: 0 in 0.531s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:08 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Temporary image 86433006-753f-43b5-b60e-7f6f6c1c77c6 is fetched for user 8a5a6efa12e84c408d96d5847f3ff255. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 12 16:22:08 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a5d1328e-ba88-4281-aeb6-f9824c400b76 tempest-GroupsTest-1973047448 None] Group tempest-GroupsTest-Group-873050643: created successfully
Aug 12 16:22:08 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a5d1328e-ba88-4281-aeb6-f9824c400b76 tempest-GroupsTest-1973047448 None] Create group completed successfully.
Aug 12 16:22:08 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b66858-ec02-4beb-8453-cae4838af694]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:22:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_ldf5fjr3devstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:08 devstack sudo[98319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_ldf5fjr3devstack@QuobyteHD
Aug 12 16:22:08 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:08 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_ldf5fjr3devstack@QuobyteHD" returned: 0 in 0.448s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:22:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:22:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1141149261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8940490f-a6f8-4ec4-af08-5636f21161eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4727be8a28114d61931e43c23090c972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:22:07Z,use_quota=True,user_id='8a5a6efa12e84c408d96d5847f3ff255',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:22:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Creating volume 8940490f-a6f8-4ec4-af08-5636f21161eb {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:22:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:22:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:22:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:22:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:22:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:22:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:22:08 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:22:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8940490f-a6f8-4ec4-af08-5636f21161eb 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:08 devstack sudo[98324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8940490f-a6f8-4ec4-af08-5636f21161eb 1073741824
Aug 12 16:22:08 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:09 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8940490f-a6f8-4ec4-af08-5636f21161eb 1073741824" returned: 0 in 0.436s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8940490f-a6f8-4ec4-af08-5636f21161eb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:09 devstack sudo[98330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8940490f-a6f8-4ec4-af08-5636f21161eb
Aug 12 16:22:09 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:09 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8940490f-a6f8-4ec4-af08-5636f21161eb" returned: 0 in 0.387s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:22:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:22:09 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Attempting download of 86433006-753f-43b5-b60e-7f6f6c1c77c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}])) to volume 8940490f-a6f8-4ec4-af08-5636f21161eb. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d203da-9cde-4983-bd91-fd3fe064dabb]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_3nfuayap {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:10 devstack sudo[98334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_3nfuayap
Aug 12 16:22:10 devstack sudo[98334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Flow 'volume_create_manager' (0a555f33-9697-4f73-9b00-58675ea7e27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac97d1c-44ca-4081-967e-4dc203a2eee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac97d1c-44ca-4081-967e-4dc203a2eee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-619735150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=796d5620-7377-4f23-9a32-12d813ff110c,host='devstack@QuobyteHD#QuobyteHD',id=0e1dcac1-f057-421d-a360-ec4b6edaf2c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e299778d192841bd940fcaab2f1a2b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:22:10Z,use_quota=True,user_id='e8a6e4d406f64733be2bfa53173212d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a85ed97-9301-4a3e-a0bc-06afee9ee34c),volume_type_id=5a85ed97-9301-4a3e-a0bc-06afee9ee34c)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d9ec99-71d4-4df4-9225-92164e23351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d9ec99-71d4-4df4-9225-92164e23351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c62621e0-1efd-4b4e-bffa-1f5987febf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c62621e0-1efd-4b4e-bffa-1f5987febf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e1dcac1-f057-421d-a360-ec4b6edaf2c4', 'volume_name': 'volume-0e1dcac1-f057-421d-a360-ec4b6edaf2c4', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360245ff-fb31-41f9-a4be-c27f8ec27587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (360245ff-fb31-41f9-a4be-c27f8ec27587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347c8c74-0948-4d09-9e76-7d846a5a6f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:10 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Volume 0e1dcac1-f057-421d-a360-ec4b6edaf2c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e1dcac1-f057-421d-a360-ec4b6edaf2c4', 'volume_size': 1}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=796d5620-7377-4f23-9a32-12d813ff110c,created_at=2026-08-12T14:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-619735150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=796d5620-7377-4f23-9a32-12d813ff110c,host='devstack@QuobyteHD#QuobyteHD',id=0e1dcac1-f057-421d-a360-ec4b6edaf2c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e299778d192841bd940fcaab2f1a2b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:22:10Z,use_quota=True,user_id='e8a6e4d406f64733be2bfa53173212d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a85ed97-9301-4a3e-a0bc-06afee9ee34c),volume_type_id=5a85ed97-9301-4a3e-a0bc-06afee9ee34c)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Creating volume 0e1dcac1-f057-421d-a360-ec4b6edaf2c4 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:22:10 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0e1dcac1-f057-421d-a360-ec4b6edaf2c4 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:10 devstack sudo[98336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0e1dcac1-f057-421d-a360-ec4b6edaf2c4 1073741824
Aug 12 16:22:10 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:10 devstack sudo[98334]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_3nfuayap" returned: 0 in 0.645s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_3nfuayap {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:10 devstack sudo[98340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_3nfuayap
Aug 12 16:22:10 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:11 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0e1dcac1-f057-421d-a360-ec4b6edaf2c4 1073741824" returned: 0 in 0.533s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:11 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0e1dcac1-f057-421d-a360-ec4b6edaf2c4 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_3nfuayap" returned: 1 in 0.544s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_3nfuayap' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:22:11 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4411ac-97b6-447f-a33d-93f10972b02a]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:22:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_ldf5fjr3devstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:11 devstack sudo[98349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0e1dcac1-f057-421d-a360-ec4b6edaf2c4
Aug 12 16:22:11 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:11 devstack sudo[98350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_ldf5fjr3devstack@QuobyteHD
Aug 12 16:22:11 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:11 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0e1dcac1-f057-421d-a360-ec4b6edaf2c4" returned: 0 in 0.417s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:22:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:22:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347c8c74-0948-4d09-9e76-7d846a5a6f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e1dcac1-f057-421d-a360-ec4b6edaf2c4', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2e2acc-c998-46de-8be2-2ed4b2edd499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:11 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Volume volume-0e1dcac1-f057-421d-a360-ec4b6edaf2c4 (0e1dcac1-f057-421d-a360-ec4b6edaf2c4): created successfully
Aug 12 16:22:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d2e2acc-c998-46de-8be2-2ed4b2edd499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Flow 'volume_create_manager' (0a555f33-9697-4f73-9b00-58675ea7e27f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:22:11 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-421f8b37-8fe5-4edf-98a3-3436e671ae9c tempest-GroupsTest-1973047448 None] Created volume successfully.
Aug 12 16:22:11 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_ldf5fjr3devstack@QuobyteHD" returned: 0 in 0.582s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:11 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] 86433006-753f-43b5-b60e-7f6f6c1c77c6 was qcow2, converting to qcow2 {{(pid=94457) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 12 16:22:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_ldf5fjr3devstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8940490f-a6f8-4ec4-af08-5636f21161eb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:11 devstack sudo[98392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_ldf5fjr3devstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8940490f-a6f8-4ec4-af08-5636f21161eb
Aug 12 16:22:11 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:13 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:22:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Flow 'volume_create_manager' (d1267f5d-1b63-4163-bd79-e7f45b2d3fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:22:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeea290a-12ca-4bb6-95ff-decdffd1901e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeea290a-12ca-4bb6-95ff-decdffd1901e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1460978886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=796d5620-7377-4f23-9a32-12d813ff110c,host='devstack@QuobyteHD#QuobyteHD',id=4c6d4c94-2a30-442a-930a-aa3c8ff49b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e299778d192841bd940fcaab2f1a2b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:22:14Z,use_quota=True,user_id='e8a6e4d406f64733be2bfa53173212d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a85ed97-9301-4a3e-a0bc-06afee9ee34c),volume_type_id=5a85ed97-9301-4a3e-a0bc-06afee9ee34c)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e5fae4-8acc-454f-9951-dd106a206162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e5fae4-8acc-454f-9951-dd106a206162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09e7d75-4523-45d4-a046-55cacab25d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09e7d75-4523-45d4-a046-55cacab25d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c6d4c94-2a30-442a-930a-aa3c8ff49b61', 'volume_name': 'volume-4c6d4c94-2a30-442a-930a-aa3c8ff49b61', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c87b90a-4ad4-4250-ace2-59caf0d5ef1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c87b90a-4ad4-4250-ace2-59caf0d5ef1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed0f387-216c-4869-bb7c-1836b30cf614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:14 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Volume 4c6d4c94-2a30-442a-930a-aa3c8ff49b61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c6d4c94-2a30-442a-930a-aa3c8ff49b61', 'volume_size': 1}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=796d5620-7377-4f23-9a32-12d813ff110c,created_at=2026-08-12T14:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1460978886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=796d5620-7377-4f23-9a32-12d813ff110c,host='devstack@QuobyteHD#QuobyteHD',id=4c6d4c94-2a30-442a-930a-aa3c8ff49b61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e299778d192841bd940fcaab2f1a2b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:22:14Z,use_quota=True,user_id='e8a6e4d406f64733be2bfa53173212d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a85ed97-9301-4a3e-a0bc-06afee9ee34c),volume_type_id=5a85ed97-9301-4a3e-a0bc-06afee9ee34c)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Creating volume 4c6d4c94-2a30-442a-930a-aa3c8ff49b61 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:22:14 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c6d4c94-2a30-442a-930a-aa3c8ff49b61 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:14 devstack sudo[98403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c6d4c94-2a30-442a-930a-aa3c8ff49b61 1073741824
Aug 12 16:22:14 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:14 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_ldf5fjr3devstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8940490f-a6f8-4ec4-af08-5636f21161eb" returned: 0 in 2.243s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_ldf5fjr3devstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8940490f-a6f8-4ec4-af08-5636f21161eb {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:22:14 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Converted 112.00 MB image at 49.86 MB/s
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8940490f-a6f8-4ec4-af08-5636f21161eb 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:14 devstack sudo[98408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8940490f-a6f8-4ec4-af08-5636f21161eb 1G
Aug 12 16:22:14 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:14 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8940490f-a6f8-4ec4-af08-5636f21161eb 1G" returned: 0 in 0.448s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Downloaded image 86433006-753f-43b5-b60e-7f6f6c1c77c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}])) to volume 8940490f-a6f8-4ec4-af08-5636f21161eb successfully. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Temporary image 86433006-753f-43b5-b60e-7f6f6c1c77c6 for user 8a5a6efa12e84c408d96d5847f3ff255 is deleted. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Marking volume 8940490f-a6f8-4ec4-af08-5636f21161eb as bootable. {{(pid=94457) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Copying metadata from image 86433006-753f-43b5-b60e-7f6f6c1c77c6 to 8940490f-a6f8-4ec4-af08-5636f21161eb. {{(pid=94457) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Creating volume glance metadata for volume 8940490f-a6f8-4ec4-af08-5636f21161eb backed by image 86433006-753f-43b5-b60e-7f6f6c1c77c6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94457) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 12 16:22:14 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c6d4c94-2a30-442a-930a-aa3c8ff49b61 1073741824" returned: 0 in 0.566s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c6d4c94-2a30-442a-930a-aa3c8ff49b61 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d8fbc1-cdd3-490a-86a1-8b77a05221c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8940490f-a6f8-4ec4-af08-5636f21161eb', 'volume_size': 1, 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b7d6f6e2f82493fb2262e877eaef313', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'created_at': datetime.datetime(2026, 8, 12, 14, 14, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 14, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86433006-753f-43b5-b60e-7f6f6c1c77c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b63cd3170>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e00a4f5-e652-4540-bcc2-a63f65470ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:14 devstack sudo[98418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c6d4c94-2a30-442a-930a-aa3c8ff49b61
Aug 12 16:22:14 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:14 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Volume volume-8940490f-a6f8-4ec4-af08-5636f21161eb (8940490f-a6f8-4ec4-af08-5636f21161eb): created successfully
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e00a4f5-e652-4540-bcc2-a63f65470ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Flow 'volume_create_manager' (0d6df24e-a45d-42bd-ab93-feddd31c2f21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:22:14 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a4c9cb48-00de-4144-9936-7bafe684c786 tempest-ServerActionsTestOtherA-809931543 None] Created volume successfully.
Aug 12 16:22:14 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c6d4c94-2a30-442a-930a-aa3c8ff49b61" returned: 0 in 0.287s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed0f387-216c-4869-bb7c-1836b30cf614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c6d4c94-2a30-442a-930a-aa3c8ff49b61', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca453cc-8a2a-4a4f-a9f2-3d3b1b2ccbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:14 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Volume volume-4c6d4c94-2a30-442a-930a-aa3c8ff49b61 (4c6d4c94-2a30-442a-930a-aa3c8ff49b61): created successfully
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca453cc-8a2a-4a4f-a9f2-3d3b1b2ccbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Flow 'volume_create_manager' (d1267f5d-1b63-4163-bd79-e7f45b2d3fbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:22:14 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-60b4fc28-c976-4f5e-a290-8968aed723a4 tempest-GroupsTest-1973047448 None] Created volume successfully.
Aug 12 16:22:15 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-99f00257-b9a5-486c-97d2-8ead8830110d tempest-GroupsTest-1973047448 None] Update group completed successfully.
Aug 12 16:22:16 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-66a0496f-7fc3-419c-8ba3-1a1c58753d66 tempest-GroupsTest-1973047448 None] Update group completed successfully.
Aug 12 16:22:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-bf38ecc0-c1d1-42ad-a7ef-5f4677d359a7 req-48b784dd-be35-4007-aebf-a322af070de8 tempest-ServerActionsTestOtherA-809931543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:22:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-bf38ecc0-c1d1-42ad-a7ef-5f4677d359a7 req-48b784dd-be35-4007-aebf-a322af070de8 tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:22:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-bf38ecc0-c1d1-42ad-a7ef-5f4677d359a7 req-48b784dd-be35-4007-aebf-a322af070de8 tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:22:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-bf38ecc0-c1d1-42ad-a7ef-5f4677d359a7 req-48b784dd-be35-4007-aebf-a322af070de8 tempest-ServerActionsTestOtherA-809931543 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-8940490f-a6f8-4ec4-af08-5636f21161eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4bbff7f-de33-4bea-8906-8115a839ff87', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:22:19 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-bf38ecc0-c1d1-42ad-a7ef-5f4677d359a7 req-48b784dd-be35-4007-aebf-a322af070de8 tempest-ServerActionsTestOtherA-809931543 None] attachment_update completed successfully.
Aug 12 16:22:19 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Acquiring lock "cinder-quobyte-0e1dcac1-f057-421d-a360-ec4b6edaf2c4" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:22:19 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Lock "cinder-quobyte-0e1dcac1-f057-421d-a360-ec4b6edaf2c4" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:22:19 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a4d8ff-1706-4100-93a9-1d4126c16ef8]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:22:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0e1dcac1-f057-421d-a360-ec4b6edaf2c4 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:19 devstack sudo[98436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0e1dcac1-f057-421d-a360-ec4b6edaf2c4
Aug 12 16:22:19 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:22:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:22:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:22:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:22:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:22:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:22:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:19 devstack sudo[98439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:22:19 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:19 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0e1dcac1-f057-421d-a360-ec4b6edaf2c4" returned: 0 in 0.660s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0e1dcac1-f057-421d-a360-ec4b6edaf2c4 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:19 devstack sudo[98445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0e1dcac1-f057-421d-a360-ec4b6edaf2c4
Aug 12 16:22:19 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:19 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.432s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:22:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:22:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 28 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:22:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:22:20 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0e1dcac1-f057-421d-a360-ec4b6edaf2c4" returned: 0 in 0.312s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:20 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Lock "cinder-quobyte-0e1dcac1-f057-421d-a360-ec4b6edaf2c4" released by "delete_volume" :: held 1.046s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:22:20 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Acquiring lock "cinder-quobyte-4c6d4c94-2a30-442a-930a-aa3c8ff49b61" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:22:20 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Lock "cinder-quobyte-4c6d4c94-2a30-442a-930a-aa3c8ff49b61" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:22:20 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[871e6bcb-4296-4d2d-808d-a2e609e4af79]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:22:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c6d4c94-2a30-442a-930a-aa3c8ff49b61 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:20 devstack sudo[98448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c6d4c94-2a30-442a-930a-aa3c8ff49b61
Aug 12 16:22:20 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:20 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c6d4c94-2a30-442a-930a-aa3c8ff49b61" returned: 0 in 0.437s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c6d4c94-2a30-442a-930a-aa3c8ff49b61 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:20 devstack sudo[98453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c6d4c94-2a30-442a-930a-aa3c8ff49b61
Aug 12 16:22:20 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:20 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4c6d4c94-2a30-442a-930a-aa3c8ff49b61" returned: 0 in 0.326s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:20 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Lock "cinder-quobyte-4c6d4c94-2a30-442a-930a-aa3c8ff49b61" released by "delete_volume" :: held 0.813s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:22:21 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Created reservations ['664736db-6602-46f6-a93c-5422d6e370ac'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:22:21 devstack cinder-volume[94457]: WARNING cinder.quota [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-790073655 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-790073655, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:22:21 devstack cinder-volume[94457]: WARNING cinder.quota [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-790073655 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-790073655, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:22:21 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Created reservations ['925e1e07-cfbe-471b-b94c-11f2eabb7c49', '48dd9f2d-07f8-4422-beb3-94bd414de265', '1bfb6d76-e3bf-4c68-8ce7-05df6bd12e9f', 'ec484a41-c3ec-4894-8f55-17d629f204bd'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:22:21 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Created reservations ['1a07d1f0-a336-4c31-9639-a82b276d37f4', '3b00ef00-8ba9-4c93-b342-c7739d49b6c9', 'd8fb9084-3e2d-4c65-ac95-034b1a6b532e', 'fbd3bf5e-ad16-4f39-9e18-aefe2f7ac56a'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:22:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:22:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:22:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:22:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:22:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:22:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:21 devstack sudo[98458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:22:21 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:21 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.378s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:21 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:22:21 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-d636c914-2140-4cb4-888a-95eb4ca8146e tempest-GroupsTest-1973047448 None] Delete group completed successfully.
Aug 12 16:22:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] Acquiring lock "cinder-6b64128f-927b-4686-8f7a-7ca4a64d5584-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:22:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] Lock "cinder-6b64128f-927b-4686-8f7a-7ca4a64d5584-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:22:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] Acquiring lock "cinder-quobyte-6b64128f-927b-4686-8f7a-7ca4a64d5584" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:22:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] Lock "cinder-quobyte-6b64128f-927b-4686-8f7a-7ca4a64d5584" acquired by "delete_volume" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:22:31 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8db3a01-f703-4acd-aa41-f3ae712ffedf]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:22:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6b64128f-927b-4686-8f7a-7ca4a64d5584 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:31 devstack sudo[98936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6b64128f-927b-4686-8f7a-7ca4a64d5584
Aug 12 16:22:31 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:32 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6b64128f-927b-4686-8f7a-7ca4a64d5584" returned: 0 in 0.653s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6b64128f-927b-4686-8f7a-7ca4a64d5584 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:32 devstack sudo[98945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6b64128f-927b-4686-8f7a-7ca4a64d5584
Aug 12 16:22:32 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:32 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6b64128f-927b-4686-8f7a-7ca4a64d5584" returned: 0 in 0.380s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] Lock "cinder-quobyte-6b64128f-927b-4686-8f7a-7ca4a64d5584" released by "delete_volume" :: held 1.152s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:22:32 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] Created reservations ['2fcfada0-1fa2-4ce3-b7c4-60b774286621', '926d1836-569a-4fd4-963e-9f7c70b85317', '2efc9e88-a588-467c-867e-34d85b4df8d6', '76848108-4e15-4b98-a975-2db2b59285b0'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:22:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:22:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:22:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:22:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:22:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:22:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:32 devstack sudo[98948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:22:32 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:22:33 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root
Aug 12 16:22:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.478s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:22:33 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:22:33 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] Deleted volume successfully.
Aug 12 16:22:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b6e0b7a4-1d48-4748-852c-fd1d9b71964f tempest-AttachVolumeShelveTestJSON-9930265 None] Lock "cinder-6b64128f-927b-4686-8f7a-7ca4a64d5584-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:22:42 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:UPDATE=81,cinder:SELECT=85,cinder:INSERT=28,cinder:DELETE=2 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:22:43 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=94,cinder:INSERT=21,cinder:UPDATE=90,cinder:DELETE=4 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:22:46 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-72e38ab0-7a71-4dc0-a014-c688ced77b4f req-e8238dfe-a4bc-48b9-8b83-d1f0acded05e tempest-ServerActionsTestOtherA-809931543 None] Terminate volume connection completed successfully.
Aug 12 16:22:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-72e38ab0-7a71-4dc0-a014-c688ced77b4f req-e8238dfe-a4bc-48b9-8b83-d1f0acded05e tempest-ServerActionsTestOtherA-809931543 None] Deleting attachment d4bbff7f-de33-4bea-8906-8115a839ff87. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:22:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-72e38ab0-7a71-4dc0-a014-c688ced77b4f req-b967f997-e5e2-4cb0-bc99-44ec86d8704f tempest-ServerActionsTestOtherA-809931543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:22:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-72e38ab0-7a71-4dc0-a014-c688ced77b4f req-b967f997-e5e2-4cb0-bc99-44ec86d8704f tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:22:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-72e38ab0-7a71-4dc0-a014-c688ced77b4f req-b967f997-e5e2-4cb0-bc99-44ec86d8704f tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:22:52 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-72e38ab0-7a71-4dc0-a014-c688ced77b4f req-b967f997-e5e2-4cb0-bc99-44ec86d8704f tempest-ServerActionsTestOtherA-809931543 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-8940490f-a6f8-4ec4-af08-5636f21161eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '55d44b00-ec21-497d-aa7b-fbd8218359c3', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:22:52 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-72e38ab0-7a71-4dc0-a014-c688ced77b4f req-b967f997-e5e2-4cb0-bc99-44ec86d8704f tempest-ServerActionsTestOtherA-809931543 None] attachment_update completed successfully.
Aug 12 16:22:56 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a305ce8a-e6ce-4f65-935d-335548932ed4 tempest-GroupsV314Test-1875739421 None] Group tempest-GroupsV314Test-Group-1424263362: creating
Aug 12 16:22:56 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a305ce8a-e6ce-4f65-935d-335548932ed4 tempest-GroupsV314Test-1875739421 None] Group tempest-GroupsV314Test-Group-1424263362: created successfully
Aug 12 16:22:56 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a305ce8a-e6ce-4f65-935d-335548932ed4 tempest-GroupsV314Test-1875739421 None] Create group completed successfully.
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Flow 'volume_create_manager' (36ac2cfb-eae5-493f-ba27-41c9e1ff0d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ab97b5-9f96-41fd-b8d4-2c116213e475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ab97b5-9f96-41fd-b8d4-2c116213e475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-969079497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=319c485a-9b8b-44e9-bbf8-94a09cb6fcce,host='devstack@QuobyteHD#QuobyteHD',id=b287695c-2d22-48ec-9d53-382c793f3f48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc7975939414cd1a17d5471ea671294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:22:59Z,use_quota=True,user_id='cad08d8568f843b48bda7549a5951a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3dcd740-ef7d-41eb-9f56-01f6063fa59b),volume_type_id=d3dcd740-ef7d-41eb-9f56-01f6063fa59b)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e4657c-316c-4592-900c-aa77c81511c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e4657c-316c-4592-900c-aa77c81511c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36bf89e-426c-46c9-b4d4-be48cb174cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36bf89e-426c-46c9-b4d4-be48cb174cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b287695c-2d22-48ec-9d53-382c793f3f48', 'volume_name': 'volume-b287695c-2d22-48ec-9d53-382c793f3f48', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6bb1fb-6ada-45b2-ac4c-b95c95df8543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6bb1fb-6ada-45b2-ac4c-b95c95df8543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db70add-e314-4d72-adbd-62204b2217c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:22:59 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Volume b287695c-2d22-48ec-9d53-382c793f3f48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b287695c-2d22-48ec-9d53-382c793f3f48', 'volume_size': 1}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=319c485a-9b8b-44e9-bbf8-94a09cb6fcce,created_at=2026-08-12T14:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-969079497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=319c485a-9b8b-44e9-bbf8-94a09cb6fcce,host='devstack@QuobyteHD#QuobyteHD',id=b287695c-2d22-48ec-9d53-382c793f3f48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddc7975939414cd1a17d5471ea671294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:22:59Z,use_quota=True,user_id='cad08d8568f843b48bda7549a5951a9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d3dcd740-ef7d-41eb-9f56-01f6063fa59b),volume_type_id=d3dcd740-ef7d-41eb-9f56-01f6063fa59b)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Creating volume b287695c-2d22-48ec-9d53-382c793f3f48 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:22:59 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:22:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:22:59 devstack sudo[99675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48 1073741824
Aug 12 16:22:59 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:00 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48 1073741824" returned: 0 in 0.932s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:00 devstack sudo[99681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48
Aug 12 16:23:00 devstack sudo[99681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:01 devstack sudo[99681]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48" returned: 0 in 0.855s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:23:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db70add-e314-4d72-adbd-62204b2217c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b287695c-2d22-48ec-9d53-382c793f3f48', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4c2f9b-e270-4c4c-b091-6db2a9bbe238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:01 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Volume volume-b287695c-2d22-48ec-9d53-382c793f3f48 (b287695c-2d22-48ec-9d53-382c793f3f48): created successfully
Aug 12 16:23:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4c2f9b-e270-4c4c-b091-6db2a9bbe238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Flow 'volume_create_manager' (36ac2cfb-eae5-493f-ba27-41c9e1ff0d5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:23:01 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-32ac0da3-b7aa-44ea-816e-0bc06065faae tempest-GroupsV314Test-1875739421 None] Created volume successfully.
Aug 12 16:23:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:23:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:23:04 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Cloning volume b287695c-2d22-48ec-9d53-382c793f3f48 to volume 245c576e-f3eb-4c40-8069-348a9aa607f4
Aug 12 16:23:04 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Creating offline snapshot 92b30fe7-8ab2-45be-8483-29eed3e1ac22 of volume b287695c-2d22-48ec-9d53-382c793f3f48 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:23:04 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2bacc0-d35f-4f31-9eab-a43bf9b1ce61]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:23:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:04 devstack sudo[99696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48
Aug 12 16:23:04 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:04 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:23:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Flow 'volume_create_manager' (02f092bf-6e3c-46ed-ad0c-6a77a4c28c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:23:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b0f0a2-d776-4b89-a8f9-9e3b1d81b7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80b0f0a2-d776-4b89-a8f9-9e3b1d81b7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1756446812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb80f39-1ab8-4565-b108-f280f32afab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0ae533afae3488e96bf13879b93a00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:23:05Z,use_quota=True,user_id='80c28675b5b9403f83f3f7bac3119480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc039e55-1598-453c-b6a9-e05a215dfe8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc039e55-1598-453c-b6a9-e05a215dfe8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7dc2c7-9fdf-42e1-a026-cf206a7391aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7dc2c7-9fdf-42e1-a026-cf206a7391aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cb80f39-1ab8-4565-b108-f280f32afab8', 'volume_name': 'volume-2cb80f39-1ab8-4565-b108-f280f32afab8', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04703e1d-1f71-4dd1-bf44-5a20fa953504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04703e1d-1f71-4dd1-bf44-5a20fa953504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ed8866-9704-44f9-8bf8-e0d9686249f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:04 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Volume 2cb80f39-1ab8-4565-b108-f280f32afab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cb80f39-1ab8-4565-b108-f280f32afab8', 'volume_size': 1}
Aug 12 16:23:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:23:05 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48" returned: 0 in 0.810s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:05 devstack sudo[99711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22 1G
Aug 12 16:23:05 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:05 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22 1G" returned: 0 in 0.598s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b287695c-2d22-48ec-9d53-382c793f3f48 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:05 devstack sudo[99723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b287695c-2d22-48ec-9d53-382c793f3f48 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22
Aug 12 16:23:05 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:06 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b287695c-2d22-48ec-9d53-382c793f3f48 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22" returned: 0 in 0.459s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:06 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22 is being set with open permissions: ugo+rw: NotImplementedError
Aug 12 16:23:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:06 devstack sudo[99734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22
Aug 12 16:23:06 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:06 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22" returned: 0 in 0.337s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:06 devstack sudo[99747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.info
Aug 12 16:23:06 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:07 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.info" returned: 0 in 0.557s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:07 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 12 16:23:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:07 devstack sudo[99766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.info
Aug 12 16:23:07 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:07 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.info" returned: 0 in 0.353s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:07 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Acquiring lock "cinder-quobyte-245c576e-f3eb-4c40-8069-348a9aa607f4" by "_copy_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:23:07 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Lock "cinder-quobyte-245c576e-f3eb-4c40-8069-348a9aa607f4" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:23:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] snapshot: 92b30fe7-8ab2-45be-8483-29eed3e1ac22, volume: 245c576e-f3eb-4c40-8069-348a9aa607f4,  {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 12 16:23:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:23:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:23:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:23:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:23:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:07 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e1ef2d-5572-44d9-b586-2833cc19f1e6]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:23:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:07 devstack sudo[99769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22
Aug 12 16:23:07 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:08 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22" returned: 0 in 0.539s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b287695c-2d22-48ec-9d53-382c793f3f48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:23:08 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5eff512-dd86-4e1b-abcd-6eee5b54bb25]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:23:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:08 devstack sudo[99774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48
Aug 12 16:23:08 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:09 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48" returned: 0 in 0.774s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48 {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 12 16:23:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Creating direct copy from snapshot {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 12 16:23:09 devstack cinder-volume[94457]: DEBUG cinder.utils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Path /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-245c576e-f3eb-4c40-8069-348a9aa607f4 not found in is_blk_device check {{(pid=94457) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 12 16:23:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-245c576e-f3eb-4c40-8069-348a9aa607f4 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:09 devstack sudo[99783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-245c576e-f3eb-4c40-8069-348a9aa607f4
Aug 12 16:23:09 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:15 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:23:15 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Flow 'volume_create_manager' (751944ec-fc0a-4dfb-8ce3-5280a53a3c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:23:15 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e81705d1-15fa-46fa-a160-ab84edb3d6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e81705d1-15fa-46fa-a160-ab84edb3d6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1570117831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d26d9fd-400f-469c-be84-a207617cab6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2820b3ea9e7f4244b1a0b2d285480371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:23:16Z,use_quota=True,user_id='89d915fbf27a4055bf8c068ab366034d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce826d74-756e-40ee-8bba-8f42b58c9a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce826d74-756e-40ee-8bba-8f42b58c9a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c328291-5429-4956-9af6-8d3cd72f85d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c328291-5429-4956-9af6-8d3cd72f85d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d26d9fd-400f-469c-be84-a207617cab6f', 'volume_name': 'volume-9d26d9fd-400f-469c-be84-a207617cab6f', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068e66a3-2963-4a13-b594-d46af552b6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (068e66a3-2963-4a13-b594-d46af552b6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ea5709-a900-4be9-b81d-169a2771d26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:16 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Volume 9d26d9fd-400f-469c-be84-a207617cab6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d26d9fd-400f-469c-be84-a207617cab6f', 'volume_size': 1}
Aug 12 16:23:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:23:16 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:UPDATE=5,cinder:SELECT=19,cinder:INSERT=3 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:23:17 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-245c576e-f3eb-4c40-8069-348a9aa607f4" returned: 0 in 8.836s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:17 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48, size 1024.00 MB, duration 8.84 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-245c576e-f3eb-4c40-8069-348a9aa607f4 {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:23:17 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Converted 1024.00 MB image at 115.87 MB/s
Aug 12 16:23:17 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-245c576e-f3eb-4c40-8069-348a9aa607f4 is being set with open permissions: ugo+rw: NotImplementedError
Aug 12 16:23:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-245c576e-f3eb-4c40-8069-348a9aa607f4 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:17 devstack sudo[99902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-245c576e-f3eb-4c40-8069-348a9aa607f4
Aug 12 16:23:17 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:18 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-245c576e-f3eb-4c40-8069-348a9aa607f4" returned: 0 in 0.320s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Lock "cinder-quobyte-245c576e-f3eb-4c40-8069-348a9aa607f4" released by "_copy_volume_from_snapshot" :: held 10.553s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:23:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Acquiring lock "cinder-quobyte-92b30fe7-8ab2-45be-8483-29eed3e1ac22" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:23:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Lock "cinder-quobyte-92b30fe7-8ab2-45be-8483-29eed3e1ac22" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:23:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Deleting offline snapshot 92b30fe7-8ab2-45be-8483-29eed3e1ac22 of volume b287695c-2d22-48ec-9d53-382c793f3f48 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:23:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] snapshot_file for this snap is: volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:23:18 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe03d80-893e-494a-8319-4650af801535]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:23:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:18 devstack sudo[99905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22
Aug 12 16:23:18 devstack sudo[99905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:18 devstack sudo[99905]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22" returned: 0 in 0.393s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b287695c-2d22-48ec-9d53-382c793f3f48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:23:18 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[17aa4de0-6caf-47bf-bcf2-5fd14057487e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:23:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:18 devstack sudo[99911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48
Aug 12 16:23:18 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:19 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48" returned: 0 in 0.564s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:19 devstack sudo[99916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22
Aug 12 16:23:19 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:23:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:23:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:23:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:23:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:23:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:19 devstack sudo[99918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:23:19 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:19 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.284s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:23:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:23:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 28 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:23:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:23:19 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22" returned: 0 in 0.457s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:19 devstack sudo[99925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22
Aug 12 16:23:19 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:20 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48.92b30fe7-8ab2-45be-8483-29eed3e1ac22" returned: 0 in 0.258s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Lock "cinder-quobyte-92b30fe7-8ab2-45be-8483-29eed3e1ac22" released by "_delete_snapshot" :: held 1.779s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.908s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.095s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1756446812',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cb80f39-1ab8-4565-b108-f280f32afab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0ae533afae3488e96bf13879b93a00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:23:05Z,use_quota=True,user_id='80c28675b5b9403f83f3f7bac3119480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Creating volume 2cb80f39-1ab8-4565-b108-f280f32afab8 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:23:20 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2cb80f39-1ab8-4565-b108-f280f32afab8 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:20 devstack sudo[99928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2cb80f39-1ab8-4565-b108-f280f32afab8 1073741824
Aug 12 16:23:20 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:20 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-cd40a196-16b0-4ca7-ac30-c125d09141d7 tempest-GroupsV314Test-1875739421 None] Create group from source-group-319c485a-9b8b-44e9-bbf8-94a09cb6fcce completed successfully.
Aug 12 16:23:20 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2cb80f39-1ab8-4565-b108-f280f32afab8 1073741824" returned: 0 in 0.517s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2cb80f39-1ab8-4565-b108-f280f32afab8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:20 devstack sudo[99934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2cb80f39-1ab8-4565-b108-f280f32afab8
Aug 12 16:23:20 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:20 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2cb80f39-1ab8-4565-b108-f280f32afab8" returned: 0 in 0.341s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.874s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1570117831',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d26d9fd-400f-469c-be84-a207617cab6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2820b3ea9e7f4244b1a0b2d285480371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:23:16Z,use_quota=True,user_id='89d915fbf27a4055bf8c068ab366034d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Creating volume 9d26d9fd-400f-469c-be84-a207617cab6f {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:23:20 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:23:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9d26d9fd-400f-469c-be84-a207617cab6f 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94ed8866-9704-44f9-8bf8-e0d9686249f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cb80f39-1ab8-4565-b108-f280f32afab8', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:21 devstack sudo[99937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9d26d9fd-400f-469c-be84-a207617cab6f 1073741824
Aug 12 16:23:21 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d831bf-c296-4d9a-9a72-3fa5aa932bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:21 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Volume volume-2cb80f39-1ab8-4565-b108-f280f32afab8 (2cb80f39-1ab8-4565-b108-f280f32afab8): created successfully
Aug 12 16:23:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d831bf-c296-4d9a-9a72-3fa5aa932bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Flow 'volume_create_manager' (02f092bf-6e3c-46ed-ad0c-6a77a4c28c97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:23:21 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c7d2e150-a9f1-4bcb-a6f8-35103546fad8 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Created volume successfully.
Aug 12 16:23:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] Acquiring lock "cinder-quobyte-245c576e-f3eb-4c40-8069-348a9aa607f4" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:23:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] Lock "cinder-quobyte-245c576e-f3eb-4c40-8069-348a9aa607f4" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:23:21 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[28876b81-96fc-43ab-8c10-e92aa946f5c8]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:23:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-245c576e-f3eb-4c40-8069-348a9aa607f4 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:21 devstack sudo[99939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-245c576e-f3eb-4c40-8069-348a9aa607f4
Aug 12 16:23:21 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Acquiring lock "cinder-2cb80f39-1ab8-4565-b108-f280f32afab8-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:23:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Lock "cinder-2cb80f39-1ab8-4565-b108-f280f32afab8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:23:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Acquiring lock "cinder-quobyte-2cb80f39-1ab8-4565-b108-f280f32afab8" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:23:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Lock "cinder-quobyte-2cb80f39-1ab8-4565-b108-f280f32afab8" acquired by "delete_volume" :: waited 0.020s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:23:21 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:21 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7b3c9c-e2da-4d53-af67-3bcc4a7e3d3f]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:23:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2cb80f39-1ab8-4565-b108-f280f32afab8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9d26d9fd-400f-469c-be84-a207617cab6f 1073741824" returned: 0 in 0.933s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9d26d9fd-400f-469c-be84-a207617cab6f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:22 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-245c576e-f3eb-4c40-8069-348a9aa607f4" returned: 0 in 0.731s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-245c576e-f3eb-4c40-8069-348a9aa607f4 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:22 devstack sudo[99953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9d26d9fd-400f-469c-be84-a207617cab6f
Aug 12 16:23:22 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:22 devstack sudo[99949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2cb80f39-1ab8-4565-b108-f280f32afab8
Aug 12 16:23:22 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:22 devstack sudo[99955]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-245c576e-f3eb-4c40-8069-348a9aa607f4
Aug 12 16:23:22 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:22 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2cb80f39-1ab8-4565-b108-f280f32afab8" returned: 0 in 0.491s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2cb80f39-1ab8-4565-b108-f280f32afab8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:22 devstack sudo[99962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2cb80f39-1ab8-4565-b108-f280f32afab8
Aug 12 16:23:22 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:22 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-245c576e-f3eb-4c40-8069-348a9aa607f4" returned: 0 in 0.434s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] Lock "cinder-quobyte-245c576e-f3eb-4c40-8069-348a9aa607f4" released by "delete_volume" :: held 1.249s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:23:22 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9d26d9fd-400f-469c-be84-a207617cab6f" returned: 0 in 0.564s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ea5709-a900-4be9-b81d-169a2771d26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d26d9fd-400f-469c-be84-a207617cab6f', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49693bd2-a86a-4663-ab92-2b92f419a05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:22 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Volume volume-9d26d9fd-400f-469c-be84-a207617cab6f (9d26d9fd-400f-469c-be84-a207617cab6f): created successfully
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49693bd2-a86a-4663-ab92-2b92f419a05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Flow 'volume_create_manager' (751944ec-fc0a-4dfb-8ce3-5280a53a3c4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] Created reservations ['8b9baa65-c80d-4bfb-9e59-9bc80a247396'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:23:22 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c673edac-1330-4f35-b08c-8690ce792325 tempest-ServerRescueNegativeTestJSON-476378507 None] Created volume successfully.
Aug 12 16:23:22 devstack cinder-volume[94457]: WARNING cinder.quota [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1587706596 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1587706596, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:23:22 devstack cinder-volume[94457]: WARNING cinder.quota [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1587706596 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1587706596, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] Created reservations ['7f6703c9-b816-409f-9efb-13afbc7bddc4', '332c9223-dd5b-4d30-a8f7-a7b1ec27b817', '15e0b970-4ab5-475d-97dc-dc2dfdb70689', 'c726f6cb-1c09-44fb-b1da-67d501c5cbf5'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:23:22 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2cb80f39-1ab8-4565-b108-f280f32afab8" returned: 0 in 0.513s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:22 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Lock "cinder-quobyte-2cb80f39-1ab8-4565-b108-f280f32afab8" released by "delete_volume" :: held 1.099s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:23:22 devstack sudo[99966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:23:22 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:23 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Created reservations ['fbe3a6df-1cb7-4d83-8cb8-20ea720b8e5a', '99e1b97c-7cd1-4816-821a-646b758f9e52', '99fe7fdf-d318-4a71-9bf4-0d9ffcb0fcb6', '744fd7fe-59d3-4281-8d97-7bf26577e340'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:23:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:23:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:23:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:23:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:23:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:23 devstack sudo[99968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:23:23 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:23 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.330s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:23 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:23:23 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-4a86525f-c1c7-4048-97c4-7932597fcfd0 tempest-GroupsV314Test-1875739421 None] Delete group completed successfully.
Aug 12 16:23:23 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.366s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:23 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:23:23 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Deleted volume successfully.
Aug 12 16:23:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-78df470c-837f-4aab-9598-7afd00519e78 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Lock "cinder-2cb80f39-1ab8-4565-b108-f280f32afab8-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:23:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5a95d1b5-bf86-4086-a6ac-5eedcbf6176f tempest-GroupsV314Test-1875739421 None] Acquiring lock "cinder-quobyte-b287695c-2d22-48ec-9d53-382c793f3f48" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:23:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5a95d1b5-bf86-4086-a6ac-5eedcbf6176f tempest-GroupsV314Test-1875739421 None] Lock "cinder-quobyte-b287695c-2d22-48ec-9d53-382c793f3f48" acquired by "delete_volume" :: waited 0.045s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:23:24 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[e684e2f8-4205-4226-af19-4b64cbde6610]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:23:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5a95d1b5-bf86-4086-a6ac-5eedcbf6176f tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:24 devstack sudo[99974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48
Aug 12 16:23:24 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Flow 'volume_create_manager' (5dc44a40-8f9a-42bc-9ac0-a90f37eecb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:23:25 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463d8e69-193f-4642-aa6c-96d87a6e93de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5a95d1b5-bf86-4086-a6ac-5eedcbf6176f tempest-GroupsV314Test-1875739421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48" returned: 0 in 0.577s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5a95d1b5-bf86-4086-a6ac-5eedcbf6176f tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (463d8e69-193f-4642-aa6c-96d87a6e93de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1731690629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4334d83c-e588-4ef7-ad8c-51d253371b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0ae533afae3488e96bf13879b93a00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:23:25Z,use_quota=True,user_id='80c28675b5b9403f83f3f7bac3119480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:25 devstack sudo[99988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48
Aug 12 16:23:25 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45544814-c603-4967-93fb-a7d29a88ba75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45544814-c603-4967-93fb-a7d29a88ba75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4249a07-8b05-4aac-929b-cf1991f92a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4249a07-8b05-4aac-929b-cf1991f92a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4334d83c-e588-4ef7-ad8c-51d253371b12', 'volume_name': 'volume-4334d83c-e588-4ef7-ad8c-51d253371b12', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15048007-9c46-4504-9c14-680c57840e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15048007-9c46-4504-9c14-680c57840e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7232fb7-2b6d-4428-881f-9f5293b45d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:25 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Volume 4334d83c-e588-4ef7-ad8c-51d253371b12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4334d83c-e588-4ef7-ad8c-51d253371b12', 'volume_size': 1}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1731690629',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4334d83c-e588-4ef7-ad8c-51d253371b12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0ae533afae3488e96bf13879b93a00b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:23:25Z,use_quota=True,user_id='80c28675b5b9403f83f3f7bac3119480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Creating volume 4334d83c-e588-4ef7-ad8c-51d253371b12 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:23:25 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4334d83c-e588-4ef7-ad8c-51d253371b12 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:25 devstack sudo[99994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4334d83c-e588-4ef7-ad8c-51d253371b12 1073741824
Aug 12 16:23:25 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:25 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5a95d1b5-bf86-4086-a6ac-5eedcbf6176f tempest-GroupsV314Test-1875739421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b287695c-2d22-48ec-9d53-382c793f3f48" returned: 0 in 0.389s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5a95d1b5-bf86-4086-a6ac-5eedcbf6176f tempest-GroupsV314Test-1875739421 None] Lock "cinder-quobyte-b287695c-2d22-48ec-9d53-382c793f3f48" released by "delete_volume" :: held 1.106s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-5a95d1b5-bf86-4086-a6ac-5eedcbf6176f tempest-GroupsV314Test-1875739421 None] Created reservations ['f46c7d45-7a8e-4190-a735-738af22a206e'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-5a95d1b5-bf86-4086-a6ac-5eedcbf6176f tempest-GroupsV314Test-1875739421 None] Created reservations ['61f4f506-5e3b-4841-99b1-3a1b79006f67', 'fc914f57-ac6e-4efa-be3b-909e7b25efd4', '92c2b8a4-970e-4455-a7e9-d7a3d35fb2e1', 'f212aa89-8f8d-40a0-bb66-c87644fb95fa'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5a95d1b5-bf86-4086-a6ac-5eedcbf6176f tempest-GroupsV314Test-1875739421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5a95d1b5-bf86-4086-a6ac-5eedcbf6176f tempest-GroupsV314Test-1875739421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5a95d1b5-bf86-4086-a6ac-5eedcbf6176f tempest-GroupsV314Test-1875739421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5a95d1b5-bf86-4086-a6ac-5eedcbf6176f tempest-GroupsV314Test-1875739421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5a95d1b5-bf86-4086-a6ac-5eedcbf6176f tempest-GroupsV314Test-1875739421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5a95d1b5-bf86-4086-a6ac-5eedcbf6176f tempest-GroupsV314Test-1875739421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:25 devstack sudo[100031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:23:25 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:25 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4334d83c-e588-4ef7-ad8c-51d253371b12 1073741824" returned: 0 in 0.696s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4334d83c-e588-4ef7-ad8c-51d253371b12 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:26 devstack sudo[100035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4334d83c-e588-4ef7-ad8c-51d253371b12
Aug 12 16:23:26 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:26 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5a95d1b5-bf86-4086-a6ac-5eedcbf6176f tempest-GroupsV314Test-1875739421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.514s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:26 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-5a95d1b5-bf86-4086-a6ac-5eedcbf6176f tempest-GroupsV314Test-1875739421 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:23:26 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5a95d1b5-bf86-4086-a6ac-5eedcbf6176f tempest-GroupsV314Test-1875739421 None] Delete group completed successfully.
Aug 12 16:23:26 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4334d83c-e588-4ef7-ad8c-51d253371b12" returned: 0 in 0.409s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:23:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7232fb7-2b6d-4428-881f-9f5293b45d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4334d83c-e588-4ef7-ad8c-51d253371b12', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9874c5e8-afe8-45a8-9892-cc87abd7b759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:26 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Volume volume-4334d83c-e588-4ef7-ad8c-51d253371b12 (4334d83c-e588-4ef7-ad8c-51d253371b12): created successfully
Aug 12 16:23:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9874c5e8-afe8-45a8-9892-cc87abd7b759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Flow 'volume_create_manager' (5dc44a40-8f9a-42bc-9ac0-a90f37eecb98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:23:26 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-dfee088c-89fc-4f73-9662-00b513170948 tempest-VolumeQuotasAdminTestJSON-1526245539 None] Created volume successfully.
Aug 12 16:23:28 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-26cbcb1b-8061-4c7f-be02-0c297ee0bd0d tempest-VolumeQuotasAdminTestJSON-1604391409 None] Transfer volume completed successfully.
Aug 12 16:23:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] Acquiring lock "cinder-4334d83c-e588-4ef7-ad8c-51d253371b12-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:23:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] Lock "cinder-4334d83c-e588-4ef7-ad8c-51d253371b12-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:23:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] Acquiring lock "cinder-quobyte-4334d83c-e588-4ef7-ad8c-51d253371b12" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:23:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] Lock "cinder-quobyte-4334d83c-e588-4ef7-ad8c-51d253371b12" acquired by "delete_volume" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:23:28 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e81b262-1796-4359-b5ee-3c35f67dee3e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:23:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4334d83c-e588-4ef7-ad8c-51d253371b12 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:29 devstack sudo[100071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4334d83c-e588-4ef7-ad8c-51d253371b12
Aug 12 16:23:29 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:29 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4334d83c-e588-4ef7-ad8c-51d253371b12" returned: 0 in 0.832s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4334d83c-e588-4ef7-ad8c-51d253371b12 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:29 devstack sudo[100078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4334d83c-e588-4ef7-ad8c-51d253371b12
Aug 12 16:23:29 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:30 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4334d83c-e588-4ef7-ad8c-51d253371b12" returned: 0 in 0.614s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] Lock "cinder-quobyte-4334d83c-e588-4ef7-ad8c-51d253371b12" released by "delete_volume" :: held 1.530s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:23:30 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] Created reservations ['45c949ac-e553-4b70-bfd7-de7c2d31f3e4', '81bb38be-d3ee-4952-a23c-8816f2be603e', '086fe463-c178-456c-93a1-0790f45acbfb', 'c467f193-197d-420e-b1e0-ea98d6fa917d'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:23:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:23:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:23:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:23:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:23:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:30 devstack sudo[100081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:23:30 devstack sudo[100081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:30 devstack sudo[100081]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.408s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:30 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:23:30 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] Deleted volume successfully.
Aug 12 16:23:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dcd4c0f1-5917-4f86-804d-efe312e72fb2 tempest-VolumeQuotasAdminTestJSON-549071100 None] Lock "cinder-4334d83c-e588-4ef7-ad8c-51d253371b12-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:23:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] Acquiring lock "cinder-9d26d9fd-400f-469c-be84-a207617cab6f-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:23:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] Lock "cinder-9d26d9fd-400f-469c-be84-a207617cab6f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:23:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] Acquiring lock "cinder-quobyte-9d26d9fd-400f-469c-be84-a207617cab6f" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:23:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] Lock "cinder-quobyte-9d26d9fd-400f-469c-be84-a207617cab6f" acquired by "delete_volume" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:23:34 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[756bd434-d935-4d67-8f57-5bb4d3ddc521]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:23:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9d26d9fd-400f-469c-be84-a207617cab6f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:35 devstack sudo[100152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9d26d9fd-400f-469c-be84-a207617cab6f
Aug 12 16:23:35 devstack sudo[100152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:35 devstack sudo[100152]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9d26d9fd-400f-469c-be84-a207617cab6f" returned: 0 in 0.584s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9d26d9fd-400f-469c-be84-a207617cab6f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:35 devstack sudo[100157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9d26d9fd-400f-469c-be84-a207617cab6f
Aug 12 16:23:35 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:35 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9d26d9fd-400f-469c-be84-a207617cab6f" returned: 0 in 0.467s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] Lock "cinder-quobyte-9d26d9fd-400f-469c-be84-a207617cab6f" released by "delete_volume" :: held 1.155s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:23:35 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] Created reservations ['d5f4c3f8-b369-40cb-9f8a-dde61824eb6c', '31394213-ca70-477a-acbb-650f1006b1f9', '4d6918e9-816b-46ff-9df0-71a76215f01f', '293053c8-79cf-4096-a2cf-ae9af934e01c'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:23:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:23:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:23:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:23:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:23:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:36 devstack sudo[100160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:23:36 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:36 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.319s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:36 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:23:36 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] Deleted volume successfully.
Aug 12 16:23:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1f004990-f65e-4ce7-8107-52c7b2d27748 tempest-ServerRescueNegativeTestJSON-476378507 None] Lock "cinder-9d26d9fd-400f-469c-be84-a207617cab6f-delete_volume" released by "delete_volume" :: held 1.822s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=53,cinder:UPDATE=61,cinder:DELETE=3,cinder:INSERT=15 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Flow 'volume_create_manager' (73293043-866c-462e-91f2-270281662216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140804a6-b1b7-4ffb-9695-967d7048cde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140804a6-b1b7-4ffb-9695-967d7048cde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1276713593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ea28f7-7b4e-492d-bc3b-ae957a43e0be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e793a6ad5b46808434681db8190f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:23:45Z,use_quota=True,user_id='45c4273eaca34b9191cca1061c0d30ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d403ef-6d8b-492d-80bc-d8d243d0a6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d403ef-6d8b-492d-80bc-d8d243d0a6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776a0584-fb96-48cc-8120-af2affdd7a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776a0584-fb96-48cc-8120-af2affdd7a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81ea28f7-7b4e-492d-bc3b-ae957a43e0be', 'volume_name': 'volume-81ea28f7-7b4e-492d-bc3b-ae957a43e0be', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e8e426-4627-4256-a094-a6bd48838167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e8e426-4627-4256-a094-a6bd48838167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1053b4-d006-4220-a96a-3fefeb83fbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:45 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Volume 81ea28f7-7b4e-492d-bc3b-ae957a43e0be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81ea28f7-7b4e-492d-bc3b-ae957a43e0be', 'volume_size': 1}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:23:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1276713593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ea28f7-7b4e-492d-bc3b-ae957a43e0be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e793a6ad5b46808434681db8190f84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:23:45Z,use_quota=True,user_id='45c4273eaca34b9191cca1061c0d30ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Creating volume 81ea28f7-7b4e-492d-bc3b-ae957a43e0be {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:23:45 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-81ea28f7-7b4e-492d-bc3b-ae957a43e0be 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:45 devstack sudo[100260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-81ea28f7-7b4e-492d-bc3b-ae957a43e0be 1073741824
Aug 12 16:23:45 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:45 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-81ea28f7-7b4e-492d-bc3b-ae957a43e0be 1073741824" returned: 0 in 0.523s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-81ea28f7-7b4e-492d-bc3b-ae957a43e0be {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:45 devstack sudo[100269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-81ea28f7-7b4e-492d-bc3b-ae957a43e0be
Aug 12 16:23:45 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:46 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-81ea28f7-7b4e-492d-bc3b-ae957a43e0be" returned: 0 in 0.352s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:23:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1053b4-d006-4220-a96a-3fefeb83fbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81ea28f7-7b4e-492d-bc3b-ae957a43e0be', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b040825a-f403-4405-a376-f87234ca8566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:23:46 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Volume volume-81ea28f7-7b4e-492d-bc3b-ae957a43e0be (81ea28f7-7b4e-492d-bc3b-ae957a43e0be): created successfully
Aug 12 16:23:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b040825a-f403-4405-a376-f87234ca8566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:23:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Flow 'volume_create_manager' (73293043-866c-462e-91f2-270281662216) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:23:46 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-84102b1f-eadc-44a6-b207-02957d95b675 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Created volume successfully.
Aug 12 16:23:46 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-78617792-b006-4bee-a481-649e3a657ba3 req-3f1cac1c-871e-483b-8502-478ab5f5dee3 tempest-ServerActionsTestOtherA-809931543 None] Terminate volume connection completed successfully.
Aug 12 16:23:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-78617792-b006-4bee-a481-649e3a657ba3 req-3f1cac1c-871e-483b-8502-478ab5f5dee3 tempest-ServerActionsTestOtherA-809931543 None] Deleting attachment 55d44b00-ec21-497d-aa7b-fbd8218359c3. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:23:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] Acquiring lock "cinder-8940490f-a6f8-4ec4-af08-5636f21161eb-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:23:47 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] Lock "cinder-8940490f-a6f8-4ec4-af08-5636f21161eb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:23:47 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] Acquiring lock "cinder-quobyte-8940490f-a6f8-4ec4-af08-5636f21161eb" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:23:47 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] Lock "cinder-quobyte-8940490f-a6f8-4ec4-af08-5636f21161eb" acquired by "delete_volume" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:23:47 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fbc3dd-33f1-452b-9837-59e30b9cdce2]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:23:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8940490f-a6f8-4ec4-af08-5636f21161eb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:47 devstack sudo[100275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8940490f-a6f8-4ec4-af08-5636f21161eb
Aug 12 16:23:47 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:47 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8940490f-a6f8-4ec4-af08-5636f21161eb" returned: 0 in 0.632s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8940490f-a6f8-4ec4-af08-5636f21161eb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:47 devstack sudo[100281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8940490f-a6f8-4ec4-af08-5636f21161eb
Aug 12 16:23:47 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] Acquiring lock "cinder-fdbab769-e86b-49df-a28b-f88185b1ab42-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] Lock "cinder-fdbab769-e86b-49df-a28b-f88185b1ab42-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:23:48 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8940490f-a6f8-4ec4-af08-5636f21161eb" returned: 0 in 0.381s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] Acquiring lock "cinder-quobyte-fdbab769-e86b-49df-a28b-f88185b1ab42" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] Lock "cinder-quobyte-8940490f-a6f8-4ec4-af08-5636f21161eb" released by "delete_volume" :: held 1.069s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] Lock "cinder-quobyte-fdbab769-e86b-49df-a28b-f88185b1ab42" acquired by "delete_volume" :: waited 0.036s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6fcb56-dc49-4ed9-b610-854352f8f343]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fdbab769-e86b-49df-a28b-f88185b1ab42 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG cinder.quota [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] Created reservations ['8b7a91e6-2aee-4108-b339-4f5da7b9bd24', 'd8b727ea-9b18-4ac1-b368-eba44928878f', '38ab3ad5-c009-4207-9521-a6e3efa1f64d', '002d6ca8-98e5-460a-bdad-93e6f68689da'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:48 devstack sudo[100284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fdbab769-e86b-49df-a28b-f88185b1ab42
Aug 12 16:23:48 devstack sudo[100284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:48 devstack sudo[100286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:23:48 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:48 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:48 devstack sudo[100284]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.418s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG cinder.manager [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fdbab769-e86b-49df-a28b-f88185b1ab42" returned: 0 in 0.568s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fdbab769-e86b-49df-a28b-f88185b1ab42 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:48 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] Deleted volume successfully.
Aug 12 16:23:48 devstack sudo[100292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fdbab769-e86b-49df-a28b-f88185b1ab42
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-78617792-b006-4bee-a481-649e3a657ba3 req-b9f9c6d4-5d96-47dc-9f86-74eec9967206 tempest-ServerActionsTestOtherA-809931543 None] Lock "cinder-8940490f-a6f8-4ec4-af08-5636f21161eb-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:23:48 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Acquiring lock "cinder-81ea28f7-7b4e-492d-bc3b-ae957a43e0be-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:23:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Lock "cinder-81ea28f7-7b4e-492d-bc3b-ae957a43e0be-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Acquiring lock "cinder-quobyte-81ea28f7-7b4e-492d-bc3b-ae957a43e0be" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Lock "cinder-quobyte-81ea28f7-7b4e-492d-bc3b-ae957a43e0be" acquired by "delete_volume" :: waited 0.019s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d865405-d736-4633-a048-43ff5365b5d6]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-81ea28f7-7b4e-492d-bc3b-ae957a43e0be {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:49 devstack sudo[100294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-81ea28f7-7b4e-492d-bc3b-ae957a43e0be
Aug 12 16:23:49 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:49 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fdbab769-e86b-49df-a28b-f88185b1ab42" returned: 0 in 0.444s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] Lock "cinder-quobyte-fdbab769-e86b-49df-a28b-f88185b1ab42" released by "delete_volume" :: held 1.090s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] Created reservations ['845d9882-9ad0-49c6-9422-f270f22692d0', '2f255a73-a8c9-4532-bf9a-2bf26798fc1d', '7b2479ef-1f0f-4607-8d57-d0026319be07', 'd5aadd12-ce81-4cbb-b677-6ca4946aad2e'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:49 devstack sudo[100299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:23:49 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:49 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-81ea28f7-7b4e-492d-bc3b-ae957a43e0be" returned: 0 in 0.454s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-81ea28f7-7b4e-492d-bc3b-ae957a43e0be {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:49 devstack sudo[100303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-81ea28f7-7b4e-492d-bc3b-ae957a43e0be
Aug 12 16:23:49 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:49 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.365s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:23:49 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] Deleted volume successfully.
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8573edb-b5cc-4a4b-8f8e-105fbfa0f366 tempest-ServerActionsTestOtherA-809931543 None] Lock "cinder-fdbab769-e86b-49df-a28b-f88185b1ab42-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:23:49 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-81ea28f7-7b4e-492d-bc3b-ae957a43e0be" returned: 0 in 0.381s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:49 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Lock "cinder-quobyte-81ea28f7-7b4e-492d-bc3b-ae957a43e0be" released by "delete_volume" :: held 0.899s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:23:50 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Created reservations ['a92bc588-d3f0-4442-85c9-af140fb647e6', '28b1bc7a-2d8e-4fc3-b075-4b0ff3c81828', '019533bd-79da-4b3a-be07-cd3b77449e4f', '1243fc4c-4b66-4e36-8a8c-1708b556ba17'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:23:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:23:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:23:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:23:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:23:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:23:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:23:50 devstack sudo[100315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:23:50 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:23:50 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root
Aug 12 16:23:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.305s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:23:50 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:23:50 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Deleted volume successfully.
Aug 12 16:23:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-999ef822-9b59-4b3c-bc9b-9a6c1fa62ac6 tempest-VolumeQuotasNegativeTestJSON-1239940302 None] Lock "cinder-81ea28f7-7b4e-492d-bc3b-ae957a43e0be-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Flow 'volume_create_manager' (480a69aa-740e-46e0-95aa-1cbabf5b44dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1719c4d-b0ac-4a7b-a265-e604bd3d8b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1719c4d-b0ac-4a7b-a265-e604bd3d8b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1260062927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a441e2a-2af9-46fa-8077-8fe1e3c88926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f504be5824804fbbbb85330d9a8e9fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:24:00Z,use_quota=True,user_id='c02405e786064adb9fdcdbfc075cf895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8199726-c662-46b6-afd2-dfb157f12bd3),volume_type_id=f8199726-c662-46b6-afd2-dfb157f12bd3)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f87b969-b65f-4626-851f-cd889cf70838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f87b969-b65f-4626-851f-cd889cf70838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6cd969-71c5-4c81-a5b0-02e88a1597de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef6cd969-71c5-4c81-a5b0-02e88a1597de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a441e2a-2af9-46fa-8077-8fe1e3c88926', 'volume_name': 'volume-1a441e2a-2af9-46fa-8077-8fe1e3c88926', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af5d807-0b82-407a-8de2-e34287f741e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af5d807-0b82-407a-8de2-e34287f741e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a29469a-2473-4928-b557-8ce43105bb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:00 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Volume 1a441e2a-2af9-46fa-8077-8fe1e3c88926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a441e2a-2af9-46fa-8077-8fe1e3c88926', 'volume_size': 1}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1260062927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a441e2a-2af9-46fa-8077-8fe1e3c88926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f504be5824804fbbbb85330d9a8e9fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:24:00Z,use_quota=True,user_id='c02405e786064adb9fdcdbfc075cf895',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f8199726-c662-46b6-afd2-dfb157f12bd3),volume_type_id=f8199726-c662-46b6-afd2-dfb157f12bd3)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Creating volume 1a441e2a-2af9-46fa-8077-8fe1e3c88926 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:24:00 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a441e2a-2af9-46fa-8077-8fe1e3c88926 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:00 devstack sudo[100354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a441e2a-2af9-46fa-8077-8fe1e3c88926 1073741824
Aug 12 16:24:00 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:00 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a441e2a-2af9-46fa-8077-8fe1e3c88926 1073741824" returned: 0 in 0.627s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a441e2a-2af9-46fa-8077-8fe1e3c88926 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:00 devstack sudo[100360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a441e2a-2af9-46fa-8077-8fe1e3c88926
Aug 12 16:24:00 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:01 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a441e2a-2af9-46fa-8077-8fe1e3c88926" returned: 0 in 0.288s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:24:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:24:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a29469a-2473-4928-b557-8ce43105bb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a441e2a-2af9-46fa-8077-8fe1e3c88926', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a2f8cb-0de5-4133-ac01-02348c00750d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:01 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Volume volume-1a441e2a-2af9-46fa-8077-8fe1e3c88926 (1a441e2a-2af9-46fa-8077-8fe1e3c88926): created successfully
Aug 12 16:24:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5a2f8cb-0de5-4133-ac01-02348c00750d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Flow 'volume_create_manager' (480a69aa-740e-46e0-95aa-1cbabf5b44dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:24:01 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-076fc573-bdf2-4368-bde1-0d1e8dbcf3da tempest-VolumeTypesAccessTest-1624686182 None] Created volume successfully.
Aug 12 16:24:02 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] Acquiring lock "cinder-1a441e2a-2af9-46fa-8077-8fe1e3c88926-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:24:02 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] Lock "cinder-1a441e2a-2af9-46fa-8077-8fe1e3c88926-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:24:02 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] Acquiring lock "cinder-quobyte-1a441e2a-2af9-46fa-8077-8fe1e3c88926" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:24:02 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] Lock "cinder-quobyte-1a441e2a-2af9-46fa-8077-8fe1e3c88926" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:24:02 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc55762-62a0-41e1-a9e1-5870dcf064f8]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:24:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a441e2a-2af9-46fa-8077-8fe1e3c88926 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:02 devstack sudo[100363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a441e2a-2af9-46fa-8077-8fe1e3c88926
Aug 12 16:24:02 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:03 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a441e2a-2af9-46fa-8077-8fe1e3c88926" returned: 0 in 0.473s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a441e2a-2af9-46fa-8077-8fe1e3c88926 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:03 devstack sudo[100368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a441e2a-2af9-46fa-8077-8fe1e3c88926
Aug 12 16:24:03 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:03 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a441e2a-2af9-46fa-8077-8fe1e3c88926" returned: 0 in 0.303s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] Lock "cinder-quobyte-1a441e2a-2af9-46fa-8077-8fe1e3c88926" released by "delete_volume" :: held 0.829s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:24:03 devstack cinder-volume[94457]: WARNING cinder.quota [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1027044193 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1027044193, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:24:03 devstack cinder-volume[94457]: WARNING cinder.quota [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1027044193 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1027044193, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:24:03 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] Created reservations ['2054341e-f8df-42c8-9409-03f8318894dd', '47e59c47-64f1-4d7f-ba24-eb3bf5e982cc', '89a855ba-e821-4896-a2ca-abda0fc15aeb', 'c4c64a73-2b9b-43ba-b4de-654ffd37ba2f'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:24:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:24:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:24:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:24:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:03 devstack sudo[100372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:24:03 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:04 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.523s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:04 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:24:04 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] Deleted volume successfully.
Aug 12 16:24:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-53a0f67a-4461-4ddb-80ae-d50ced489012 tempest-VolumeTypesAccessTest-1624686182 None] Lock "cinder-1a441e2a-2af9-46fa-8077-8fe1e3c88926-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:24:08 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:24:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Flow 'volume_create_manager' (1e69b00c-28f6-44fc-be20-35e1fa9bd9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:24:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b157b089-5fdb-4e81-9fd3-cedd1db966db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b157b089-5fdb-4e81-9fd3-cedd1db966db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1044715252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa81281a-7d45-4eef-a31f-d1ec6671d7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23c431efd6c0449ead9fb64bc123c0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:24:09Z,use_quota=True,user_id='08840ebc0fd24455a94f91324a2c41cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b0c619-1a97-4229-9444-810efc2c70b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49b0c619-1a97-4229-9444-810efc2c70b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e5f603-3cd0-4bfa-acd0-67f0c8f93fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:08 devstack cinder-volume[94457]: DEBUG cinder.image.glance [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Creating Keystone auth plugin from conf {{(pid=94457) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 12 16:24:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e5f603-3cd0-4bfa-acd0-67f0c8f93fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fa81281a-7d45-4eef-a31f-d1ec6671d7a6', 'volume_name': 'volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6', 'volume_size': 1, 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b7d6f6e2f82493fb2262e877eaef313', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'created_at': datetime.datetime(2026, 8, 12, 14, 14, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 14, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86433006-753f-43b5-b60e-7f6f6c1c77c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b63647410>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0807460e-8f1e-4644-a7f2-97796c6a75d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0807460e-8f1e-4644-a7f2-97796c6a75d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8df52ef-2c1f-45a5-9bda-f116c3a31663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:09 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Volume fa81281a-7d45-4eef-a31f-d1ec6671d7a6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6', 'volume_size': 1, 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b7d6f6e2f82493fb2262e877eaef313', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'created_at': datetime.datetime(2026, 8, 12, 14, 14, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 14, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86433006-753f-43b5-b60e-7f6f6c1c77c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b63647410>}
Aug 12 16:24:09 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Trying to clone fa81281a-7d45-4eef-a31f-d1ec6671d7a6 from image 86433006-753f-43b5-b60e-7f6f6c1c77c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]). {{(pid=94457) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 12 16:24:09 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_wtiupyhhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 12 16:24:09 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Image download 20.69 MB at 20.69 MB/s
Aug 12 16:24:09 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e6d2b3-4d6a-47ef-87c0-90218a677c45]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:24:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_wtiupyhhdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:09 devstack sudo[100377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_wtiupyhhdevstack@QuobyteHD
Aug 12 16:24:09 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:10 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_wtiupyhhdevstack@QuobyteHD" returned: 0 in 0.362s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:10 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Temporary image 86433006-753f-43b5-b60e-7f6f6c1c77c6 is fetched for user 08840ebc0fd24455a94f91324a2c41cb. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 12 16:24:10 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05bf8fb-10b3-4ce5-b85a-141090e5f7f5]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:24:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_wtiupyhhdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:10 devstack sudo[100383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_wtiupyhhdevstack@QuobyteHD
Aug 12 16:24:10 devstack sudo[100383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:10 devstack sudo[100383]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_wtiupyhhdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1044715252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa81281a-7d45-4eef-a31f-d1ec6671d7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23c431efd6c0449ead9fb64bc123c0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:24:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:24:09Z,use_quota=True,user_id='08840ebc0fd24455a94f91324a2c41cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:24:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Creating volume fa81281a-7d45-4eef-a31f-d1ec6671d7a6 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:24:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:24:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:24:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:24:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:24:10 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:24:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:10 devstack sudo[100389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6 1073741824
Aug 12 16:24:10 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:11 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6 1073741824" returned: 0 in 0.620s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:11 devstack sudo[100398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6
Aug 12 16:24:11 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:11 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6" returned: 0 in 0.272s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:24:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:24:11 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Attempting download of 86433006-753f-43b5-b60e-7f6f6c1c77c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}])) to volume fa81281a-7d45-4eef-a31f-d1ec6671d7a6. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 12 16:24:11 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00640f0-0047-4ffb-a9af-6fb25aec871a]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:24:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_l_4k64al {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:11 devstack sudo[100401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_l_4k64al
Aug 12 16:24:11 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:12 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_l_4k64al" returned: 0 in 0.529s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_l_4k64al {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:12 devstack sudo[100407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_l_4k64al
Aug 12 16:24:12 devstack sudo[100407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:12 devstack sudo[100407]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_l_4k64al" returned: 1 in 0.350s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_l_4k64al' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:24:12 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc79c08-ec21-4821-9581-76c9d6e1848d]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:24:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_wtiupyhhdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:12 devstack sudo[100411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_wtiupyhhdevstack@QuobyteHD
Aug 12 16:24:12 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:13 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_wtiupyhhdevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:13 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] 86433006-753f-43b5-b60e-7f6f6c1c77c6 was qcow2, converting to qcow2 {{(pid=94457) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 12 16:24:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_wtiupyhhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:13 devstack sudo[100417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_wtiupyhhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6
Aug 12 16:24:13 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:15 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_wtiupyhhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6" returned: 0 in 2.719s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:15 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_wtiupyhhdevstack@QuobyteHD, size 112.00 MB, duration 2.72 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6 {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:24:15 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Converted 112.00 MB image at 41.15 MB/s
Aug 12 16:24:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:15 devstack sudo[100441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6 1G
Aug 12 16:24:15 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:16 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6 1G" returned: 0 in 0.413s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:16 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Downloaded image 86433006-753f-43b5-b60e-7f6f6c1c77c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}])) to volume fa81281a-7d45-4eef-a31f-d1ec6671d7a6 successfully. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 12 16:24:16 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Temporary image 86433006-753f-43b5-b60e-7f6f6c1c77c6 for user 08840ebc0fd24455a94f91324a2c41cb is deleted. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 12 16:24:16 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Marking volume fa81281a-7d45-4eef-a31f-d1ec6671d7a6 as bootable. {{(pid=94457) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 12 16:24:16 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Copying metadata from image 86433006-753f-43b5-b60e-7f6f6c1c77c6 to fa81281a-7d45-4eef-a31f-d1ec6671d7a6. {{(pid=94457) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 12 16:24:16 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Creating volume glance metadata for volume fa81281a-7d45-4eef-a31f-d1ec6671d7a6 backed by image 86433006-753f-43b5-b60e-7f6f6c1c77c6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94457) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 12 16:24:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8df52ef-2c1f-45a5-9bda-f116c3a31663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6', 'volume_size': 1, 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b7d6f6e2f82493fb2262e877eaef313', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'created_at': datetime.datetime(2026, 8, 12, 14, 14, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 14, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86433006-753f-43b5-b60e-7f6f6c1c77c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b63647410>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93ee5f6-fb62-4ddc-b217-5c4ccd2e4e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:16 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Volume volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6 (fa81281a-7d45-4eef-a31f-d1ec6671d7a6): created successfully
Aug 12 16:24:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e93ee5f6-fb62-4ddc-b217-5c4ccd2e4e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Flow 'volume_create_manager' (1e69b00c-28f6-44fc-be20-35e1fa9bd9dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:24:16 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-74dfa79b-1514-4aac-ac68-a05d3aaed0a8 tempest-VolumesImageMetadata-536945292 None] Created volume successfully.
Aug 12 16:24:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] Acquiring lock "cinder-fa81281a-7d45-4eef-a31f-d1ec6671d7a6-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:24:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] Lock "cinder-fa81281a-7d45-4eef-a31f-d1ec6671d7a6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:24:17 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:UPDATE=108,cinder:SELECT=76,cinder:INSERT=29,cinder:DELETE=10 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:24:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] Acquiring lock "cinder-quobyte-fa81281a-7d45-4eef-a31f-d1ec6671d7a6" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:24:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] Lock "cinder-quobyte-fa81281a-7d45-4eef-a31f-d1ec6671d7a6" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:24:18 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[312c608e-971c-42b9-b3b6-031e611dba2d]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:24:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:18 devstack sudo[100484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6
Aug 12 16:24:18 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:18 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6" returned: 0 in 0.465s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:18 devstack sudo[100490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6
Aug 12 16:24:18 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:18 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fa81281a-7d45-4eef-a31f-d1ec6671d7a6" returned: 0 in 0.424s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] Lock "cinder-quobyte-fa81281a-7d45-4eef-a31f-d1ec6671d7a6" released by "delete_volume" :: held 0.974s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] Created reservations ['0fcab5cb-6508-4b69-bbfd-0fd8f50cb5aa', '8f9a4202-29b3-435a-9423-f73c1a91e2ff', '000ca028-2eb7-4e0c-a92b-c59ef078698f', 'b43bd41a-a869-4d53-86a3-1c6763d7b686'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:19 devstack sudo[100494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:24:19 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:19 devstack sudo[100496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:24:19 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:19 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.417s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:24:19 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] Deleted volume successfully.
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-739a6bd8-16b4-4928-b621-da387893399f tempest-VolumesImageMetadata-536945292 None] Lock "cinder-fa81281a-7d45-4eef-a31f-d1ec6671d7a6-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:24:19 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.364s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 28 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:24:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:24:29 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:24:29 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=40,cinder:UPDATE=49,cinder:INSERT=15,cinder:DELETE=2 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Flow 'volume_create_manager' (268297a6-f1ea-4d7c-a9a8-8b0007554ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79bd210b-1225-46d0-b0ce-64ea7c43858b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79bd210b-1225-46d0-b0ce-64ea7c43858b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1133015407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702d0ae6-4126-452e-8cfa-17fee545b0b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17ecf049cfc4214a7d8bc454728e5b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:24:31Z,use_quota=True,user_id='e3b6e7dcc7454f06a45f996d6efb1f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef75581-dfb4-46a5-8eef-a87638fd0273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ef75581-dfb4-46a5-8eef-a87638fd0273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb84bb8f-8f07-4a2a-a903-1f31315cd1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb84bb8f-8f07-4a2a-a903-1f31315cd1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '702d0ae6-4126-452e-8cfa-17fee545b0b1', 'volume_name': 'volume-702d0ae6-4126-452e-8cfa-17fee545b0b1', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6190db-5318-4a7c-a5ae-1db3fd76db5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6190db-5318-4a7c-a5ae-1db3fd76db5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7eb498-7278-4794-aa8d-598d302f9ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:31 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Volume 702d0ae6-4126-452e-8cfa-17fee545b0b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-702d0ae6-4126-452e-8cfa-17fee545b0b1', 'volume_size': 1}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1133015407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702d0ae6-4126-452e-8cfa-17fee545b0b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17ecf049cfc4214a7d8bc454728e5b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:24:31Z,use_quota=True,user_id='e3b6e7dcc7454f06a45f996d6efb1f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Creating volume 702d0ae6-4126-452e-8cfa-17fee545b0b1 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:24:31 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:24:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-702d0ae6-4126-452e-8cfa-17fee545b0b1 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:31 devstack sudo[100678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-702d0ae6-4126-452e-8cfa-17fee545b0b1 1073741824
Aug 12 16:24:31 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:32 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-702d0ae6-4126-452e-8cfa-17fee545b0b1 1073741824" returned: 0 in 0.718s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-702d0ae6-4126-452e-8cfa-17fee545b0b1 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:32 devstack sudo[100705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-702d0ae6-4126-452e-8cfa-17fee545b0b1
Aug 12 16:24:32 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:32 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-702d0ae6-4126-452e-8cfa-17fee545b0b1" returned: 0 in 0.397s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:24:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:24:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb7eb498-7278-4794-aa8d-598d302f9ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-702d0ae6-4126-452e-8cfa-17fee545b0b1', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79e41e0-6ddf-4b00-bdc5-cab7e22513d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:32 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Volume volume-702d0ae6-4126-452e-8cfa-17fee545b0b1 (702d0ae6-4126-452e-8cfa-17fee545b0b1): created successfully
Aug 12 16:24:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79e41e0-6ddf-4b00-bdc5-cab7e22513d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Flow 'volume_create_manager' (268297a6-f1ea-4d7c-a9a8-8b0007554ead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:24:32 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-d71bc334-3729-425f-a745-5a6137fec569 tempest-VolumesTransfersV355Test-1072139551 None] Created volume successfully.
Aug 12 16:24:35 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5b636e78-d430-4424-ba44-bdd7caa70031 tempest-VolumesTransfersV355Test-1899559972 None] Transfer volume completed successfully.
Aug 12 16:24:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] Acquiring lock "cinder-702d0ae6-4126-452e-8cfa-17fee545b0b1-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:24:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] Lock "cinder-702d0ae6-4126-452e-8cfa-17fee545b0b1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:24:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] Acquiring lock "cinder-quobyte-702d0ae6-4126-452e-8cfa-17fee545b0b1" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:24:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] Lock "cinder-quobyte-702d0ae6-4126-452e-8cfa-17fee545b0b1" acquired by "delete_volume" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:24:36 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[061c2cde-f780-4f7c-8150-688d5a074bf2]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:24:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-702d0ae6-4126-452e-8cfa-17fee545b0b1 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:36 devstack sudo[100739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-702d0ae6-4126-452e-8cfa-17fee545b0b1
Aug 12 16:24:36 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:37 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-702d0ae6-4126-452e-8cfa-17fee545b0b1" returned: 0 in 0.642s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-702d0ae6-4126-452e-8cfa-17fee545b0b1 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:37 devstack sudo[100744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-702d0ae6-4126-452e-8cfa-17fee545b0b1
Aug 12 16:24:37 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:37 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-702d0ae6-4126-452e-8cfa-17fee545b0b1" returned: 0 in 0.330s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] Lock "cinder-quobyte-702d0ae6-4126-452e-8cfa-17fee545b0b1" released by "delete_volume" :: held 1.061s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:24:37 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] Created reservations ['eb5e5e8d-5fca-4f7d-93bc-d3e3eddcdb99', '7820b1e4-dde2-4b24-a382-50fe563bfaab', 'c04262e7-4ac2-4e0d-9565-5cf4fc8d447e', '2c2c4645-5e83-4825-9a30-54646cdb8648'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:24:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:24:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:24:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:24:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:37 devstack sudo[100749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:24:38 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:38 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.302s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:38 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:24:38 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] Deleted volume successfully.
Aug 12 16:24:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2d0d6d08-db11-429a-b9b3-dc79d70471be tempest-VolumesTransfersV355Test-653817680 None] Lock "cinder-702d0ae6-4126-452e-8cfa-17fee545b0b1-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:24:39 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:24:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Flow 'volume_create_manager' (2fbd512e-dfb9-4c59-9748-ad37b54fd901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:24:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4d329c-cbe1-401f-b10a-d9ae386f4973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c4d329c-cbe1-401f-b10a-d9ae386f4973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1026823452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff2f805-a3da-4fec-98e6-6a6897701efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17ecf049cfc4214a7d8bc454728e5b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:24:40Z,use_quota=True,user_id='e3b6e7dcc7454f06a45f996d6efb1f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e623ae3-1066-4118-b659-7c96b19f5d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e623ae3-1066-4118-b659-7c96b19f5d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e96f95-ef9f-4e5d-a6c0-c0f06ee0bd89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86e96f95-ef9f-4e5d-a6c0-c0f06ee0bd89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dff2f805-a3da-4fec-98e6-6a6897701efc', 'volume_name': 'volume-dff2f805-a3da-4fec-98e6-6a6897701efc', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99793e80-fd64-4fec-9282-d3d72fa4bf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99793e80-fd64-4fec-9282-d3d72fa4bf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06272d7-b2ae-4a9a-9071-a5a46e2b93a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:40 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Volume dff2f805-a3da-4fec-98e6-6a6897701efc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dff2f805-a3da-4fec-98e6-6a6897701efc', 'volume_size': 1}
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1026823452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff2f805-a3da-4fec-98e6-6a6897701efc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f17ecf049cfc4214a7d8bc454728e5b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:24:40Z,use_quota=True,user_id='e3b6e7dcc7454f06a45f996d6efb1f5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Creating volume dff2f805-a3da-4fec-98e6-6a6897701efc {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:24:40 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dff2f805-a3da-4fec-98e6-6a6897701efc 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:40 devstack sudo[100768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dff2f805-a3da-4fec-98e6-6a6897701efc 1073741824
Aug 12 16:24:40 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:40 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dff2f805-a3da-4fec-98e6-6a6897701efc 1073741824" returned: 0 in 0.674s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dff2f805-a3da-4fec-98e6-6a6897701efc {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:40 devstack sudo[100776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dff2f805-a3da-4fec-98e6-6a6897701efc
Aug 12 16:24:40 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:41 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dff2f805-a3da-4fec-98e6-6a6897701efc" returned: 0 in 0.364s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:41 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:24:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:24:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c06272d7-b2ae-4a9a-9071-a5a46e2b93a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff2f805-a3da-4fec-98e6-6a6897701efc', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f7b9f5-bed5-4886-a157-1ce3f5d4a531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:41 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Volume volume-dff2f805-a3da-4fec-98e6-6a6897701efc (dff2f805-a3da-4fec-98e6-6a6897701efc): created successfully
Aug 12 16:24:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f7b9f5-bed5-4886-a157-1ce3f5d4a531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Flow 'volume_create_manager' (2fbd512e-dfb9-4c59-9748-ad37b54fd901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:24:41 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ea6b92f3-6e7b-4173-85f3-a60144bc4843 tempest-VolumesTransfersV355Test-1072139551 None] Created volume successfully.
Aug 12 16:24:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] Acquiring lock "cinder-dff2f805-a3da-4fec-98e6-6a6897701efc-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:24:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] Lock "cinder-dff2f805-a3da-4fec-98e6-6a6897701efc-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:24:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] Acquiring lock "cinder-quobyte-dff2f805-a3da-4fec-98e6-6a6897701efc" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:24:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] Lock "cinder-quobyte-dff2f805-a3da-4fec-98e6-6a6897701efc" acquired by "delete_volume" :: waited 0.044s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:24:42 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[50af7f49-3a6a-4b3a-86a8-2ed80b138913]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:24:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dff2f805-a3da-4fec-98e6-6a6897701efc {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:43 devstack sudo[100801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dff2f805-a3da-4fec-98e6-6a6897701efc
Aug 12 16:24:43 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:43 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dff2f805-a3da-4fec-98e6-6a6897701efc" returned: 0 in 0.922s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dff2f805-a3da-4fec-98e6-6a6897701efc {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:43 devstack sudo[100816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dff2f805-a3da-4fec-98e6-6a6897701efc
Aug 12 16:24:43 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:44 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dff2f805-a3da-4fec-98e6-6a6897701efc" returned: 0 in 0.707s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] Lock "cinder-quobyte-dff2f805-a3da-4fec-98e6-6a6897701efc" released by "delete_volume" :: held 1.765s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:24:44 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] Created reservations ['f019f5ee-6ff7-4228-b7f9-83359338193a', '8fb770f7-dbe1-459f-acfc-253e4f2e30ce', 'df29c698-44fd-4c90-a435-fcb4f9045ab1', 'c9ff1867-c13c-4931-a61c-f73267350093'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:24:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:24:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:24:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:24:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:44 devstack sudo[100845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:24:44 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:45 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.715s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:45 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:24:45 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] Deleted volume successfully.
Aug 12 16:24:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-72b409c0-8173-443f-94a0-5144d0c3f259 tempest-VolumesTransfersV355Test-653817680 None] Lock "cinder-dff2f805-a3da-4fec-98e6-6a6897701efc-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:24:48 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:24:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Flow 'volume_create_manager' (c641d911-2499-4274-be7a-c1ebd5118f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:24:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cd57db-4095-44ee-ad85-6a501a8669c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cd57db-4095-44ee-ad85-6a501a8669c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1454038168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42622a7e-9959-48aa-b595-079339905f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8468ce87fb44cfbf006f7bbd4e0c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:24:49Z,use_quota=True,user_id='2ee817bc23744a52be661f9de34d6b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5ab7bd-6782-4daf-99ca-683633d16768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5ab7bd-6782-4daf-99ca-683633d16768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537e8263-06f7-48c1-b71a-97615b399cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (537e8263-06f7-48c1-b71a-97615b399cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42622a7e-9959-48aa-b595-079339905f35', 'volume_name': 'volume-42622a7e-9959-48aa-b595-079339905f35', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03639a8-dc43-400e-a99f-5bf6f1342bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03639a8-dc43-400e-a99f-5bf6f1342bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31204cd-8e68-427a-92c2-207e5a1b4dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:49 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Volume 42622a7e-9959-48aa-b595-079339905f35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42622a7e-9959-48aa-b595-079339905f35', 'volume_size': 1}
Aug 12 16:24:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1454038168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42622a7e-9959-48aa-b595-079339905f35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8468ce87fb44cfbf006f7bbd4e0c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:24:49Z,use_quota=True,user_id='2ee817bc23744a52be661f9de34d6b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:24:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Creating volume 42622a7e-9959-48aa-b595-079339905f35 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:24:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:24:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:24:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:24:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:24:49 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:24:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-42622a7e-9959-48aa-b595-079339905f35 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:49 devstack sudo[100875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-42622a7e-9959-48aa-b595-079339905f35 1073741824
Aug 12 16:24:49 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:50 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-42622a7e-9959-48aa-b595-079339905f35 1073741824" returned: 0 in 1.052s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-42622a7e-9959-48aa-b595-079339905f35 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:50 devstack sudo[100887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-42622a7e-9959-48aa-b595-079339905f35
Aug 12 16:24:50 devstack sudo[100887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:50 devstack sudo[100887]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-42622a7e-9959-48aa-b595-079339905f35" returned: 0 in 0.656s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:24:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:24:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31204cd-8e68-427a-92c2-207e5a1b4dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42622a7e-9959-48aa-b595-079339905f35', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce22fd3-2f05-4f9f-bfed-6e507e63c15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:50 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Volume volume-42622a7e-9959-48aa-b595-079339905f35 (42622a7e-9959-48aa-b595-079339905f35): created successfully
Aug 12 16:24:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bce22fd3-2f05-4f9f-bfed-6e507e63c15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Flow 'volume_create_manager' (c641d911-2499-4274-be7a-c1ebd5118f52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:24:51 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-63a82489-acd8-4347-8607-97e8412d9322 tempest-AttachVolumeTestJSON-2133361617 None] Created volume successfully.
Aug 12 16:24:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-2c5074c6-a490-4d3c-bfa4-f1190acd96ba req-bff47316-6434-4009-b1cf-13ed64fc1fa9 tempest-AttachVolumeTestJSON-2133361617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-2c5074c6-a490-4d3c-bfa4-f1190acd96ba req-bff47316-6434-4009-b1cf-13ed64fc1fa9 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-2c5074c6-a490-4d3c-bfa4-f1190acd96ba req-bff47316-6434-4009-b1cf-13ed64fc1fa9 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:24:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-2c5074c6-a490-4d3c-bfa4-f1190acd96ba req-bff47316-6434-4009-b1cf-13ed64fc1fa9 tempest-AttachVolumeTestJSON-2133361617 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-42622a7e-9959-48aa-b595-079339905f35', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05e71f02-e21e-4569-8530-d05130cd6ba6', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:24:53 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-2c5074c6-a490-4d3c-bfa4-f1190acd96ba req-bff47316-6434-4009-b1cf-13ed64fc1fa9 tempest-AttachVolumeTestJSON-2133361617 None] attachment_update completed successfully.
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Flow 'volume_create_manager' (3d705556-aaef-4b0e-a685-002184bcb537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80eea83a-f88b-492d-bc90-fd98983143f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80eea83a-f88b-492d-bc90-fd98983143f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-31215017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81f92fd-0bd4-446a-9720-862c9d4030e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16d6602b96eb465698ad05cc8330958d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:24:57Z,use_quota=True,user_id='ba284bf6e6d14b95be7ae963a5d20253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25362de9-25f5-4ce8-9aaa-19b46f9dcd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25362de9-25f5-4ce8-9aaa-19b46f9dcd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d01eee3-8c67-4c15-be73-05ff921645c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d01eee3-8c67-4c15-be73-05ff921645c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b81f92fd-0bd4-446a-9720-862c9d4030e9', 'volume_name': 'volume-b81f92fd-0bd4-446a-9720-862c9d4030e9', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de56a194-5b52-4e8d-871e-1a4b815e43e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de56a194-5b52-4e8d-871e-1a4b815e43e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9eb7dee-6dc7-42a9-a80e-575bf424b26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:56 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Volume b81f92fd-0bd4-446a-9720-862c9d4030e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b81f92fd-0bd4-446a-9720-862c9d4030e9', 'volume_size': 1}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-31215017',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b81f92fd-0bd4-446a-9720-862c9d4030e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16d6602b96eb465698ad05cc8330958d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:24:57Z,use_quota=True,user_id='ba284bf6e6d14b95be7ae963a5d20253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Creating volume b81f92fd-0bd4-446a-9720-862c9d4030e9 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:24:56 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:24:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b81f92fd-0bd4-446a-9720-862c9d4030e9 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:56 devstack sudo[101337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b81f92fd-0bd4-446a-9720-862c9d4030e9 1073741824
Aug 12 16:24:56 devstack sudo[101337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:57 devstack sudo[101337]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b81f92fd-0bd4-446a-9720-862c9d4030e9 1073741824" returned: 0 in 0.607s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b81f92fd-0bd4-446a-9720-862c9d4030e9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:57 devstack sudo[101348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b81f92fd-0bd4-446a-9720-862c9d4030e9
Aug 12 16:24:57 devstack sudo[101348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:24:57 devstack sudo[101348]: pam_unix(sudo:session): session closed for user root
Aug 12 16:24:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b81f92fd-0bd4-446a-9720-862c9d4030e9" returned: 0 in 0.392s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:24:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:24:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:24:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9eb7dee-6dc7-42a9-a80e-575bf424b26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b81f92fd-0bd4-446a-9720-862c9d4030e9', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5327fcca-191f-427e-8169-103d923cd210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:57 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Volume volume-b81f92fd-0bd4-446a-9720-862c9d4030e9 (b81f92fd-0bd4-446a-9720-862c9d4030e9): created successfully
Aug 12 16:24:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5327fcca-191f-427e-8169-103d923cd210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Flow 'volume_create_manager' (3d705556-aaef-4b0e-a685-002184bcb537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:24:57 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-3fdba495-8ef3-4a9c-8dce-7da6b8fab1b7 tempest-ServersNegativeTestJSON-1988476257 None] Created volume successfully.
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Flow 'volume_create_manager' (f34ad607-b1cb-42e4-b1d4-6650621db82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d444c552-34d2-4183-b9fd-4481d39ab8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d444c552-34d2-4183-b9fd-4481d39ab8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1823797573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=593e7d01-5d09-419c-9b78-c8e8a16532a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29906704d8714469a2cd59c92191563b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:24:59Z,use_quota=True,user_id='ff7f028667ec4bf4ba27b2848d146799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e5c978-c1c0-49e2-9836-bcbcb7fa8fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e5c978-c1c0-49e2-9836-bcbcb7fa8fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4d076a-cd9a-4a7c-bfac-0a2ecb230ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4d076a-cd9a-4a7c-bfac-0a2ecb230ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '593e7d01-5d09-419c-9b78-c8e8a16532a8', 'volume_name': 'volume-593e7d01-5d09-419c-9b78-c8e8a16532a8', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2891513-0015-4cc3-b6cf-c6bdabd13cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2891513-0015-4cc3-b6cf-c6bdabd13cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe183fe-3a88-4d4a-8736-f52122d7c1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:24:59 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Volume 593e7d01-5d09-419c-9b78-c8e8a16532a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-593e7d01-5d09-419c-9b78-c8e8a16532a8', 'volume_size': 1}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1823797573',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=593e7d01-5d09-419c-9b78-c8e8a16532a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29906704d8714469a2cd59c92191563b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:24:59Z,use_quota=True,user_id='ff7f028667ec4bf4ba27b2848d146799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Creating volume 593e7d01-5d09-419c-9b78-c8e8a16532a8 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:24:59 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:24:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593e7d01-5d09-419c-9b78-c8e8a16532a8 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:24:59 devstack sudo[101357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593e7d01-5d09-419c-9b78-c8e8a16532a8 1073741824
Aug 12 16:24:59 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:00 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593e7d01-5d09-419c-9b78-c8e8a16532a8 1073741824" returned: 0 in 0.598s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593e7d01-5d09-419c-9b78-c8e8a16532a8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:00 devstack sudo[101365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593e7d01-5d09-419c-9b78-c8e8a16532a8
Aug 12 16:25:00 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:00 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593e7d01-5d09-419c-9b78-c8e8a16532a8" returned: 0 in 0.702s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:25:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe183fe-3a88-4d4a-8736-f52122d7c1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-593e7d01-5d09-419c-9b78-c8e8a16532a8', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7775554b-7347-45dc-afba-cdf4719d6021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:01 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Volume volume-593e7d01-5d09-419c-9b78-c8e8a16532a8 (593e7d01-5d09-419c-9b78-c8e8a16532a8): created successfully
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7775554b-7347-45dc-afba-cdf4719d6021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Flow 'volume_create_manager' (f34ad607-b1cb-42e4-b1d4-6650621db82a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:01 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-46d53992-4f22-45c0-841d-1f23cf7d96fb tempest-VolumesTransfersV357Test-1453252728 None] Created volume successfully.
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Flow 'volume_create_manager' (b0e373eb-1169-4207-bc38-14ee82748ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79615a55-0afb-4fe8-a0f6-33d4549b84f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79615a55-0afb-4fe8-a0f6-33d4549b84f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1649893173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2ec970-dadc-4923-a54c-7e31b319c7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16d6602b96eb465698ad05cc8330958d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:01Z,use_quota=True,user_id='ba284bf6e6d14b95be7ae963a5d20253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc40a1b0-7ad0-4ea1-b793-483b633edfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc40a1b0-7ad0-4ea1-b793-483b633edfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf097aba-e47f-4dfc-97d0-6bb1d1831a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf097aba-e47f-4dfc-97d0-6bb1d1831a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a2ec970-dadc-4923-a54c-7e31b319c7ab', 'volume_name': 'volume-5a2ec970-dadc-4923-a54c-7e31b319c7ab', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b637566e-81fe-428b-9a7c-cdf3d2e88807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b637566e-81fe-428b-9a7c-cdf3d2e88807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8690b1a8-ef28-43cf-98bf-dfd1d9f4d7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:01 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Volume 5a2ec970-dadc-4923-a54c-7e31b319c7ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a2ec970-dadc-4923-a54c-7e31b319c7ab', 'volume_size': 1}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1649893173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2ec970-dadc-4923-a54c-7e31b319c7ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16d6602b96eb465698ad05cc8330958d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:01Z,use_quota=True,user_id='ba284bf6e6d14b95be7ae963a5d20253',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Creating volume 5a2ec970-dadc-4923-a54c-7e31b319c7ab {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:25:01 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:25:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a2ec970-dadc-4923-a54c-7e31b319c7ab 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:01 devstack sudo[101797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a2ec970-dadc-4923-a54c-7e31b319c7ab 1073741824
Aug 12 16:25:01 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:02 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a2ec970-dadc-4923-a54c-7e31b319c7ab 1073741824" returned: 0 in 0.524s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a2ec970-dadc-4923-a54c-7e31b319c7ab {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:02 devstack sudo[101826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a2ec970-dadc-4923-a54c-7e31b319c7ab
Aug 12 16:25:02 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:02 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a2ec970-dadc-4923-a54c-7e31b319c7ab" returned: 0 in 0.484s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:02 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:25:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8690b1a8-ef28-43cf-98bf-dfd1d9f4d7be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a2ec970-dadc-4923-a54c-7e31b319c7ab', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b0c8d4-c47d-443c-9202-a9486b655516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:02 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Volume volume-5a2ec970-dadc-4923-a54c-7e31b319c7ab (5a2ec970-dadc-4923-a54c-7e31b319c7ab): created successfully
Aug 12 16:25:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b0c8d4-c47d-443c-9202-a9486b655516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Flow 'volume_create_manager' (b0e373eb-1169-4207-bc38-14ee82748ef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:02 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-d9909259-b5ae-4f1f-85d5-daf527237e1c tempest-ServersNegativeTestJSON-1988476257 None] Created volume successfully.
Aug 12 16:25:03 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a92dc5ec-8bc6-4c3d-814a-aeeca4f2b267 tempest-VolumesTransfersV357Test-812736265 None] Transfer volume completed successfully.
Aug 12 16:25:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] Acquiring lock "cinder-593e7d01-5d09-419c-9b78-c8e8a16532a8-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] Lock "cinder-593e7d01-5d09-419c-9b78-c8e8a16532a8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] Acquiring lock "cinder-quobyte-593e7d01-5d09-419c-9b78-c8e8a16532a8" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] Lock "cinder-quobyte-593e7d01-5d09-419c-9b78-c8e8a16532a8" acquired by "delete_volume" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:03 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[7829a68c-529b-4e51-89c8-6eb869c4790f]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593e7d01-5d09-419c-9b78-c8e8a16532a8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] Acquiring lock "cinder-5a2ec970-dadc-4923-a54c-7e31b319c7ab-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:04 devstack sudo[102216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593e7d01-5d09-419c-9b78-c8e8a16532a8
Aug 12 16:25:04 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] Lock "cinder-5a2ec970-dadc-4923-a54c-7e31b319c7ab-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] Acquiring lock "cinder-quobyte-5a2ec970-dadc-4923-a54c-7e31b319c7ab" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] Lock "cinder-quobyte-5a2ec970-dadc-4923-a54c-7e31b319c7ab" acquired by "delete_volume" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:04 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde9d212-15be-4de6-b82a-8c5ac8009567]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a2ec970-dadc-4923-a54c-7e31b319c7ab {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:04 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593e7d01-5d09-419c-9b78-c8e8a16532a8" returned: 0 in 0.512s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593e7d01-5d09-419c-9b78-c8e8a16532a8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:04 devstack sudo[102223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a2ec970-dadc-4923-a54c-7e31b319c7ab
Aug 12 16:25:04 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:04 devstack sudo[102228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593e7d01-5d09-419c-9b78-c8e8a16532a8
Aug 12 16:25:04 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:04 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a2ec970-dadc-4923-a54c-7e31b319c7ab" returned: 0 in 0.522s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a2ec970-dadc-4923-a54c-7e31b319c7ab {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:04 devstack sudo[102235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a2ec970-dadc-4923-a54c-7e31b319c7ab
Aug 12 16:25:04 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:04 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593e7d01-5d09-419c-9b78-c8e8a16532a8" returned: 0 in 0.438s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] Lock "cinder-quobyte-593e7d01-5d09-419c-9b78-c8e8a16532a8" released by "delete_volume" :: held 1.026s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:05 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] Created reservations ['a24d0482-11df-497b-af18-21cf250fe71a', 'e2429140-d06f-4df2-b724-66104134ab52', 'a64b2512-0c5f-4be7-b274-cb0f3d27cf2d', '1170b6ff-412b-459d-a0cb-f0ed72316704'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:25:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:05 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a2ec970-dadc-4923-a54c-7e31b319c7ab" returned: 0 in 0.369s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:05 devstack sudo[102240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:25:05 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] Lock "cinder-quobyte-5a2ec970-dadc-4923-a54c-7e31b319c7ab" released by "delete_volume" :: held 0.974s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:05 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] Created reservations ['6abd4cf8-c08e-46b4-9ed4-234ebac8fb27', '7fa3c548-b753-49ba-a0c9-7172f9a7b159', '7d8190f1-0329-4730-903a-d615c97bcfc6', '5304fa4f-4df1-41a1-a49f-804fd3741c19'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:25:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:05 devstack sudo[102242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:25:05 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:05 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.522s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:05 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:25:05 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] Deleted volume successfully.
Aug 12 16:25:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a6521b31-fff5-4eb8-a020-f7c8e255531f tempest-VolumesTransfersV357Test-677710734 None] Lock "cinder-593e7d01-5d09-419c-9b78-c8e8a16532a8-delete_volume" released by "delete_volume" :: held 1.890s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:06 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.542s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:06 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:25:06 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] Deleted volume successfully.
Aug 12 16:25:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2fc6e9c4-dc2c-4888-b784-c43a60dffd1d tempest-ServersNegativeTestJSON-1988476257 None] Lock "cinder-5a2ec970-dadc-4923-a54c-7e31b319c7ab-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] Acquiring lock "cinder-b81f92fd-0bd4-446a-9720-862c9d4030e9-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] Lock "cinder-b81f92fd-0bd4-446a-9720-862c9d4030e9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] Acquiring lock "cinder-quobyte-b81f92fd-0bd4-446a-9720-862c9d4030e9" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] Lock "cinder-quobyte-b81f92fd-0bd4-446a-9720-862c9d4030e9" acquired by "delete_volume" :: waited 0.049s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:06 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0ccf40-b98e-4748-b42c-7c20d364831c]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b81f92fd-0bd4-446a-9720-862c9d4030e9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:07 devstack sudo[102248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b81f92fd-0bd4-446a-9720-862c9d4030e9
Aug 12 16:25:07 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Flow 'volume_create_manager' (ae1abbe3-7177-4b8c-9d38-2bf17cfa575b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (855dc86f-ee34-4f66-b36a-771ab0e499ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (855dc86f-ee34-4f66-b36a-771ab0e499ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1833456619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad9e0710-607b-47a3-8f2a-b955eb4be03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29906704d8714469a2cd59c92191563b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:07Z,use_quota=True,user_id='ff7f028667ec4bf4ba27b2848d146799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fef8f3-dda0-4cee-a16d-fd4b83bd69ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fef8f3-dda0-4cee-a16d-fd4b83bd69ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ece19e1-3161-4749-b498-a0314ab94d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ece19e1-3161-4749-b498-a0314ab94d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad9e0710-607b-47a3-8f2a-b955eb4be03b', 'volume_name': 'volume-ad9e0710-607b-47a3-8f2a-b955eb4be03b', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e456a32-9de5-45b6-b445-af166a3061ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e456a32-9de5-45b6-b445-af166a3061ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5dd263-a028-4ff3-b050-55d39d3ebb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:07 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Volume ad9e0710-607b-47a3-8f2a-b955eb4be03b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad9e0710-607b-47a3-8f2a-b955eb4be03b', 'volume_size': 1}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1833456619',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad9e0710-607b-47a3-8f2a-b955eb4be03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29906704d8714469a2cd59c92191563b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:07Z,use_quota=True,user_id='ff7f028667ec4bf4ba27b2848d146799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Creating volume ad9e0710-607b-47a3-8f2a-b955eb4be03b {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:25:07 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ad9e0710-607b-47a3-8f2a-b955eb4be03b 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:07 devstack sudo[102250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ad9e0710-607b-47a3-8f2a-b955eb4be03b 1073741824
Aug 12 16:25:07 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:07 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b81f92fd-0bd4-446a-9720-862c9d4030e9" returned: 0 in 0.678s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b81f92fd-0bd4-446a-9720-862c9d4030e9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:07 devstack sudo[102256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b81f92fd-0bd4-446a-9720-862c9d4030e9
Aug 12 16:25:07 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:07 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b81f92fd-0bd4-446a-9720-862c9d4030e9" returned: 0 in 0.441s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] Lock "cinder-quobyte-b81f92fd-0bd4-446a-9720-862c9d4030e9" released by "delete_volume" :: held 1.229s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:07 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ad9e0710-607b-47a3-8f2a-b955eb4be03b 1073741824" returned: 0 in 0.741s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ad9e0710-607b-47a3-8f2a-b955eb4be03b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:08 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] Created reservations ['ebb32bac-467c-4813-b3ca-fcbbb0e5995f', '942920a2-2758-45ab-b37a-6cf5615e8a24', '82577bf7-42e1-4d4c-b03c-326c10b849ac', '1e48f07e-6933-4241-b24d-e4d9d99eb04f'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:25:08 devstack sudo[102263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ad9e0710-607b-47a3-8f2a-b955eb4be03b
Aug 12 16:25:08 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:08 devstack sudo[102265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:25:08 devstack sudo[102265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:08 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ad9e0710-607b-47a3-8f2a-b955eb4be03b" returned: 0 in 0.371s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:25:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df5dd263-a028-4ff3-b050-55d39d3ebb55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad9e0710-607b-47a3-8f2a-b955eb4be03b', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96c013a-f3d8-4522-8664-6dee675d674b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:08 devstack sudo[102265]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.290s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:08 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:25:08 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] Deleted volume successfully.
Aug 12 16:25:08 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Volume volume-ad9e0710-607b-47a3-8f2a-b955eb4be03b (ad9e0710-607b-47a3-8f2a-b955eb4be03b): created successfully
Aug 12 16:25:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96c013a-f3d8-4522-8664-6dee675d674b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Flow 'volume_create_manager' (ae1abbe3-7177-4b8c-9d38-2bf17cfa575b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:08 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-f426aa08-e9a6-4375-95b1-5bea093df29b tempest-VolumesTransfersV357Test-1453252728 None] Created volume successfully.
Aug 12 16:25:08 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1e6a0a4b-7717-4178-a9ac-c7ec7eabe0c7 tempest-ServersNegativeTestJSON-1988476257 None] Lock "cinder-b81f92fd-0bd4-446a-9720-862c9d4030e9-delete_volume" released by "delete_volume" :: held 1.886s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] Acquiring lock "cinder-ad9e0710-607b-47a3-8f2a-b955eb4be03b-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] Lock "cinder-ad9e0710-607b-47a3-8f2a-b955eb4be03b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] Acquiring lock "cinder-quobyte-ad9e0710-607b-47a3-8f2a-b955eb4be03b" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] Lock "cinder-quobyte-ad9e0710-607b-47a3-8f2a-b955eb4be03b" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:09 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc93d763-e064-4b26-bcf5-64a0faf80d0e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ad9e0710-607b-47a3-8f2a-b955eb4be03b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:09 devstack sudo[102276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ad9e0710-607b-47a3-8f2a-b955eb4be03b
Aug 12 16:25:09 devstack sudo[102276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:10 devstack sudo[102276]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ad9e0710-607b-47a3-8f2a-b955eb4be03b" returned: 0 in 0.764s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ad9e0710-607b-47a3-8f2a-b955eb4be03b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:10 devstack sudo[102386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ad9e0710-607b-47a3-8f2a-b955eb4be03b
Aug 12 16:25:10 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:10 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ad9e0710-607b-47a3-8f2a-b955eb4be03b" returned: 0 in 0.519s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] Lock "cinder-quobyte-ad9e0710-607b-47a3-8f2a-b955eb4be03b" released by "delete_volume" :: held 1.353s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:11 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] Created reservations ['d3eac2fb-71e6-4093-8ab4-111fb5bd4a5b', '4ac8da28-47ee-4ba5-bb9c-410199b68341', '0a5b990d-3ef6-4509-9f55-a486ef39719d', 'aca21362-6a11-452f-83f0-3e2371cd8eda'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:25:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:11 devstack sudo[102390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:25:11 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:11 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.355s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:11 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:25:11 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] Deleted volume successfully.
Aug 12 16:25:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-96b1f36f-a287-441b-810f-12afa4827bed tempest-VolumesTransfersV357Test-677710734 None] Lock "cinder-ad9e0710-607b-47a3-8f2a-b955eb4be03b-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:25:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:19 devstack sudo[102477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:25:19 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:19 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.385s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:25:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:25:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 28 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:25:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Flow 'volume_create_manager' (c80b536f-a19f-4c56-97f1-65a8535a1ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3119006e-9be5-4af8-bbbe-ea80407a5092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3119006e-9be5-4af8-bbbe-ea80407a5092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-522642799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17d367a-dd35-4507-9ba3-49f94af59641,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a1b4918891974a0ca191d943f87c3a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:20Z,use_quota=True,user_id='b76ae204362a4388b2f3acaf63a4f842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b235074-c03f-4f05-848b-f4f0e687a561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b235074-c03f-4f05-848b-f4f0e687a561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc6f2e5-5202-4074-bc07-b396c216b609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc6f2e5-5202-4074-bc07-b396c216b609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a17d367a-dd35-4507-9ba3-49f94af59641', 'volume_name': 'volume-a17d367a-dd35-4507-9ba3-49f94af59641', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831d4428-07d7-4e97-a95f-e4cefd7b09c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (831d4428-07d7-4e97-a95f-e4cefd7b09c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b871834-a129-4649-90ea-72d72ff1b85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:20 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Volume a17d367a-dd35-4507-9ba3-49f94af59641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a17d367a-dd35-4507-9ba3-49f94af59641', 'volume_size': 1}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-522642799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17d367a-dd35-4507-9ba3-49f94af59641,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a1b4918891974a0ca191d943f87c3a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:20Z,use_quota=True,user_id='b76ae204362a4388b2f3acaf63a4f842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Creating volume a17d367a-dd35-4507-9ba3-49f94af59641 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:25:20 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a17d367a-dd35-4507-9ba3-49f94af59641 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:20 devstack sudo[102481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a17d367a-dd35-4507-9ba3-49f94af59641 1073741824
Aug 12 16:25:20 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:20 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a17d367a-dd35-4507-9ba3-49f94af59641 1073741824" returned: 0 in 0.568s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a17d367a-dd35-4507-9ba3-49f94af59641 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:21 devstack sudo[102512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a17d367a-dd35-4507-9ba3-49f94af59641
Aug 12 16:25:21 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:21 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a17d367a-dd35-4507-9ba3-49f94af59641" returned: 0 in 0.298s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:25:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b871834-a129-4649-90ea-72d72ff1b85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a17d367a-dd35-4507-9ba3-49f94af59641', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b3b658a-1b56-4e4a-9ce5-60934c17ad6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:21 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Volume volume-a17d367a-dd35-4507-9ba3-49f94af59641 (a17d367a-dd35-4507-9ba3-49f94af59641): created successfully
Aug 12 16:25:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b3b658a-1b56-4e4a-9ce5-60934c17ad6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Flow 'volume_create_manager' (c80b536f-a19f-4c56-97f1-65a8535a1ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:21 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-751fd162-fe8f-4970-82fb-e2d2ea2d3448 tempest-VolumesGetTest-1084562085 None] Created volume successfully.
Aug 12 16:25:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3914bc8e-d55d-4a63-804c-7776290952c0 tempest-BackendsCapabilitiesAdminTestsJSON-1102879633 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94457) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Aug 12 16:25:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-dcfb5bfe-4a8c-4720-8e3d-c30b57abf726 tempest-BackendsCapabilitiesAdminTestsJSON-1102879633 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94457) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Flow 'volume_create_manager' (3efa8d17-6e59-4af0-8e67-94705da3d0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd5f23a-d16a-4047-aec1-03e3642b99a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fd5f23a-d16a-4047-aec1-03e3642b99a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1263904383',display_name='tempest-VolumesGetTest-Volume-122267035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6130ce08-cc3a-4acc-b25c-a675259de24c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b4918891974a0ca191d943f87c3a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:23Z,use_quota=True,user_id='b76ae204362a4388b2f3acaf63a4f842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3490ec7b-489c-4f83-b12f-fe7a67ae97f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3490ec7b-489c-4f83-b12f-fe7a67ae97f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f91a8ced-406e-4ba3-9ccc-573375a47f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f91a8ced-406e-4ba3-9ccc-573375a47f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6130ce08-cc3a-4acc-b25c-a675259de24c', 'volume_name': 'volume-6130ce08-cc3a-4acc-b25c-a675259de24c', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e608159-1873-4da7-a0f5-dfa9f3076998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e608159-1873-4da7-a0f5-dfa9f3076998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba28d10b-97e4-4a76-9635-f98b3579a3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:23 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Volume 6130ce08-cc3a-4acc-b25c-a675259de24c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6130ce08-cc3a-4acc-b25c-a675259de24c', 'volume_size': 1}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1263904383',display_name='tempest-VolumesGetTest-Volume-122267035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6130ce08-cc3a-4acc-b25c-a675259de24c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b4918891974a0ca191d943f87c3a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:23Z,use_quota=True,user_id='b76ae204362a4388b2f3acaf63a4f842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Creating volume 6130ce08-cc3a-4acc-b25c-a675259de24c {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:25:23 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:25:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6130ce08-cc3a-4acc-b25c-a675259de24c 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:23 devstack sudo[102598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6130ce08-cc3a-4acc-b25c-a675259de24c 1073741824
Aug 12 16:25:23 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:24 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6130ce08-cc3a-4acc-b25c-a675259de24c 1073741824" returned: 0 in 0.618s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6130ce08-cc3a-4acc-b25c-a675259de24c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:24 devstack sudo[102606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6130ce08-cc3a-4acc-b25c-a675259de24c
Aug 12 16:25:24 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:24 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6130ce08-cc3a-4acc-b25c-a675259de24c" returned: 0 in 0.452s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:25:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba28d10b-97e4-4a76-9635-f98b3579a3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6130ce08-cc3a-4acc-b25c-a675259de24c', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911ac3ec-b5cb-4af5-bc67-01d55ba77add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:24 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Volume volume-6130ce08-cc3a-4acc-b25c-a675259de24c (6130ce08-cc3a-4acc-b25c-a675259de24c): created successfully
Aug 12 16:25:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (911ac3ec-b5cb-4af5-bc67-01d55ba77add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Flow 'volume_create_manager' (3efa8d17-6e59-4af0-8e67-94705da3d0b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:24 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5c894da4-12d8-4a68-a8ce-8b1bc0fccc6a tempest-VolumesGetTest-1084562085 None] Created volume successfully.
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] Acquiring lock "cinder-6130ce08-cc3a-4acc-b25c-a675259de24c-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] Lock "cinder-6130ce08-cc3a-4acc-b25c-a675259de24c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] Acquiring lock "cinder-quobyte-6130ce08-cc3a-4acc-b25c-a675259de24c" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] Lock "cinder-quobyte-6130ce08-cc3a-4acc-b25c-a675259de24c" acquired by "delete_volume" :: waited 0.035s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f01c0d-3267-4ed1-b24e-dd4a71a0a3e5]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6130ce08-cc3a-4acc-b25c-a675259de24c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:26 devstack sudo[102609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6130ce08-cc3a-4acc-b25c-a675259de24c
Aug 12 16:25:26 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Flow 'volume_create_manager' (a768c18a-a65a-4985-9428-7099f1cfa813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb962927-8d8b-4a77-9745-03b295139396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb962927-8d8b-4a77-9745-03b295139396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2145919608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f645cb7a-f62a-4be5-b1e9-1b92d7c09da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea567aa363ad4885a0aaa0c38f9c9fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:27Z,use_quota=True,user_id='602e329e842a453fb753e66788b52fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18aead3-e1e0-4f57-968b-13269176cb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b18aead3-e1e0-4f57-968b-13269176cb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65edf0c2-ebc9-4d96-a7da-a9d985cf02d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:26 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65edf0c2-ebc9-4d96-a7da-a9d985cf02d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f645cb7a-f62a-4be5-b1e9-1b92d7c09da3', 'volume_name': 'volume-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111fbfde-df1e-4e97-8d68-5d4f18498931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (111fbfde-df1e-4e97-8d68-5d4f18498931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28a796a-e6d8-4bd9-b24d-c32db65507cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:26 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Volume f645cb7a-f62a-4be5-b1e9-1b92d7c09da3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3', 'volume_size': 1}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2145919608',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f645cb7a-f62a-4be5-b1e9-1b92d7c09da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea567aa363ad4885a0aaa0c38f9c9fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:27Z,use_quota=True,user_id='602e329e842a453fb753e66788b52fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Creating volume f645cb7a-f62a-4be5-b1e9-1b92d7c09da3 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:25:26 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6130ce08-cc3a-4acc-b25c-a675259de24c" returned: 0 in 0.625s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6130ce08-cc3a-4acc-b25c-a675259de24c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:26 devstack sudo[102614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3 1073741824
Aug 12 16:25:26 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:26 devstack sudo[102615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6130ce08-cc3a-4acc-b25c-a675259de24c
Aug 12 16:25:26 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:27 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6130ce08-cc3a-4acc-b25c-a675259de24c" returned: 0 in 0.389s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:27 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] Lock "cinder-quobyte-6130ce08-cc3a-4acc-b25c-a675259de24c" released by "delete_volume" :: held 1.107s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:27 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] Created reservations ['0fa92aed-4411-4d18-9d1d-1292a5ee4bbc', '1d0e3b7e-ba4c-4abb-bffa-9ab32e51d939', 'f46b6dea-0224-4b72-91cb-baa9a91b3801', '18a6942e-874b-49a6-bd15-65c4a28f6562'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:25:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:27 devstack sudo[102625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:25:27 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:27 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3 1073741824" returned: 0 in 0.842s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:27 devstack sudo[102627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3
Aug 12 16:25:27 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:27 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.385s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:27 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:25:27 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] Deleted volume successfully.
Aug 12 16:25:27 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e13c3890-5cca-4e53-92ee-17f3362dc53a tempest-VolumesGetTest-1084562085 None] Lock "cinder-6130ce08-cc3a-4acc-b25c-a675259de24c-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:28 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3" returned: 0 in 0.333s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:28 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:25:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f28a796a-e6d8-4bd9-b24d-c32db65507cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507c8d12-6620-4582-b096-489bc8743578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:28 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Volume volume-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3 (f645cb7a-f62a-4be5-b1e9-1b92d7c09da3): created successfully
Aug 12 16:25:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507c8d12-6620-4582-b096-489bc8743578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Flow 'volume_create_manager' (a768c18a-a65a-4985-9428-7099f1cfa813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:28 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-9d9f310a-f7a7-40d3-95af-b0760a68be0f tempest-VolumesActionsTest-622136765 None] Created volume successfully.
Aug 12 16:25:28 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-f6a5000d-bfa1-4ff9-af57-a3fa25405d03 req-d83099ee-1d65-4818-ac78-38436539b2d2 tempest-AttachVolumeTestJSON-2133361617 None] Terminate volume connection completed successfully.
Aug 12 16:25:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-f6a5000d-bfa1-4ff9-af57-a3fa25405d03 req-d83099ee-1d65-4818-ac78-38436539b2d2 tempest-AttachVolumeTestJSON-2133361617 None] Deleting attachment 05e71f02-e21e-4569-8530-d05130cd6ba6. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:25:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] Acquiring lock "cinder-a17d367a-dd35-4507-9ba3-49f94af59641-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] Lock "cinder-a17d367a-dd35-4507-9ba3-49f94af59641-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] Acquiring lock "cinder-quobyte-a17d367a-dd35-4507-9ba3-49f94af59641" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] Lock "cinder-quobyte-a17d367a-dd35-4507-9ba3-49f94af59641" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:28 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[320cb610-6f8e-4c29-a256-22116327319c]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a17d367a-dd35-4507-9ba3-49f94af59641 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:28 devstack sudo[102637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a17d367a-dd35-4507-9ba3-49f94af59641
Aug 12 16:25:28 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c53d5fc7-b028-4cf0-bde8-850a9592d130 tempest-VolumesActionsTest-622136765 None] Acquiring lock "cinder-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3" by "attach_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:29 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c53d5fc7-b028-4cf0-bde8-850a9592d130 tempest-VolumesActionsTest-622136765 None] Lock "cinder-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3" acquired by "attach_volume" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:29 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c53d5fc7-b028-4cf0-bde8-850a9592d130 tempest-VolumesActionsTest-622136765 None] Attaching volume f645cb7a-f62a-4be5-b1e9-1b92d7c09da3 to instance abf08057-4a6d-4b06-8bd9-3b4656a6e9c1 at mountpoint /dev/vdb on host None.
Aug 12 16:25:29 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c53d5fc7-b028-4cf0-bde8-850a9592d130 tempest-VolumesActionsTest-622136765 None] Attach volume completed successfully.
Aug 12 16:25:29 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c53d5fc7-b028-4cf0-bde8-850a9592d130 tempest-VolumesActionsTest-622136765 None] Lock "cinder-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3" released by "attach_volume" :: held 0.163s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:29 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a17d367a-dd35-4507-9ba3-49f94af59641" returned: 0 in 0.595s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a17d367a-dd35-4507-9ba3-49f94af59641 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:29 devstack sudo[102647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a17d367a-dd35-4507-9ba3-49f94af59641
Aug 12 16:25:29 devstack sudo[102647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:29 devstack sudo[102647]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a17d367a-dd35-4507-9ba3-49f94af59641" returned: 0 in 0.536s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:29 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] Lock "cinder-quobyte-a17d367a-dd35-4507-9ba3-49f94af59641" released by "delete_volume" :: held 1.230s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:29 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=73,cinder:INSERT=22,cinder:UPDATE=85,cinder:DELETE=9 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:25:29 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:UPDATE=95,cinder:SELECT=66,cinder:INSERT=18,cinder:DELETE=8 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:25:29 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] Created reservations ['add68d89-5d0a-495b-8632-43d71246f5eb', '86226f11-a206-4aff-a0a4-91b3b68c8564', 'a7fb56db-562d-4f39-bfcd-280367b28f23', '23293b91-bab4-4abf-8599-8c7b6fb1a8f1'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:25:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:30 devstack sudo[102655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:25:30 devstack sudo[102655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:30 devstack sudo[102655]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.302s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:30 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:25:30 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] Deleted volume successfully.
Aug 12 16:25:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bf2dec20-7742-4b2d-807e-ac78397a69b9 tempest-VolumesGetTest-1084562085 None] Lock "cinder-a17d367a-dd35-4507-9ba3-49f94af59641-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:30 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-55c24b5c-35e1-417f-bec2-f76d174da6b8 tempest-VolumesActionsTest-1355229510 None] Terminate volume connection completed successfully.
Aug 12 16:25:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-55c24b5c-35e1-417f-bec2-f76d174da6b8 tempest-VolumesActionsTest-1355229510 None] Acquiring lock "cinder-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3-detach_volume" by "detach_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-55c24b5c-35e1-417f-bec2-f76d174da6b8 tempest-VolumesActionsTest-1355229510 None] Lock "cinder-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:30 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-55c24b5c-35e1-417f-bec2-f76d174da6b8 tempest-VolumesActionsTest-1355229510 None] Detaching volume f645cb7a-f62a-4be5-b1e9-1b92d7c09da3 from instance abf08057-4a6d-4b06-8bd9-3b4656a6e9c1.
Aug 12 16:25:30 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-55c24b5c-35e1-417f-bec2-f76d174da6b8 tempest-VolumesActionsTest-1355229510 None] Detach volume completed successfully.
Aug 12 16:25:30 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-6f066839-3f08-4dec-a756-3afd91539486 tempest-GroupSnapshotsTest-2118143769 None] Group tempest-GroupSnapshotsTest-Group-871248275: creating
Aug 12 16:25:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-55c24b5c-35e1-417f-bec2-f76d174da6b8 tempest-VolumesActionsTest-1355229510 None] Lock "cinder-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3-detach_volume" released by "detach_volume" :: held 0.153s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:30 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-6f066839-3f08-4dec-a756-3afd91539486 tempest-GroupSnapshotsTest-2118143769 None] Group tempest-GroupSnapshotsTest-Group-871248275: created successfully
Aug 12 16:25:30 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-6f066839-3f08-4dec-a756-3afd91539486 tempest-GroupSnapshotsTest-2118143769 None] Create group completed successfully.
Aug 12 16:25:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-77e3717a-5bf1-48bf-bc3d-99fc6446018c tempest-VolumesActionsTest-622136765 None] Acquiring lock "cinder-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3-detach_volume" by "detach_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-77e3717a-5bf1-48bf-bc3d-99fc6446018c tempest-VolumesActionsTest-622136765 None] Lock "cinder-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:30 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-77e3717a-5bf1-48bf-bc3d-99fc6446018c tempest-VolumesActionsTest-622136765 None] Volume detach called, but volume not attached.
Aug 12 16:25:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-77e3717a-5bf1-48bf-bc3d-99fc6446018c tempest-VolumesActionsTest-622136765 None] Lock "cinder-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] Acquiring lock "cinder-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] Lock "cinder-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] Acquiring lock "cinder-quobyte-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] Lock "cinder-quobyte-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3" acquired by "delete_volume" :: waited 0.038s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[01013048-3c54-4bba-9326-0a3906601504]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:31 devstack sudo[102659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3
Aug 12 16:25:31 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Flow 'volume_create_manager' (75db4466-cc07-4c62-939b-98261c73f948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda522be-ceb2-4823-b4c5-67b0b4eff94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda522be-ceb2-4823-b4c5-67b0b4eff94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-998047412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f7dfdb-dce8-403f-b834-c97701d3708c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b4918891974a0ca191d943f87c3a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:32Z,use_quota=True,user_id='b76ae204362a4388b2f3acaf63a4f842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2608929-b5b4-46b9-ba48-cc03d021fb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2608929-b5b4-46b9-ba48-cc03d021fb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455f15b3-7896-4688-8afc-286c0c13d8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (455f15b3-7896-4688-8afc-286c0c13d8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23f7dfdb-dce8-403f-b834-c97701d3708c', 'volume_name': 'volume-23f7dfdb-dce8-403f-b834-c97701d3708c', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b686f6b8-7a22-42da-8e12-40fbb12267ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b686f6b8-7a22-42da-8e12-40fbb12267ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55927003-0dd5-4462-aca8-bc260f2c5543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:31 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Volume 23f7dfdb-dce8-403f-b834-c97701d3708c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23f7dfdb-dce8-403f-b834-c97701d3708c', 'volume_size': 1}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-998047412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f7dfdb-dce8-403f-b834-c97701d3708c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b4918891974a0ca191d943f87c3a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:32Z,use_quota=True,user_id='b76ae204362a4388b2f3acaf63a4f842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Creating volume 23f7dfdb-dce8-403f-b834-c97701d3708c {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:25:31 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:25:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:32 devstack sudo[102664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c 1073741824
Aug 12 16:25:32 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:32 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3" returned: 0 in 0.573s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:32 devstack sudo[102673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3
Aug 12 16:25:32 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3" returned: 0 in 0.685s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:32 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] Lock "cinder-quobyte-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3" released by "delete_volume" :: held 1.331s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:32 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] Created reservations ['2080a02b-6336-4372-9ac6-365d6a021922', '20014e12-de13-4749-b147-c465983e7a7c', '57df0b21-7098-49a8-bcc7-7882b8063b8e', '3d1d8347-53a3-41c1-bdda-487898bb30c4'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:33 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c 1073741824" returned: 0 in 1.252s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:33 devstack sudo[102700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:25:33 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:33 devstack sudo[102702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c
Aug 12 16:25:33 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Flow 'volume_create_manager' (2fed6673-d191-4e79-895d-8e0112943ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:33 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c513ff5-6478-49cc-8db1-153415f03d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.485s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c513ff5-6478-49cc-8db1-153415f03d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-986520305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a48299f3-4c1f-4d75-80f1-a20b557041ff,host='devstack@QuobyteHD#QuobyteHD',id=1d43fa16-a324-4289-8ffa-b12bc200f0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75c9057fa5a4409a5333acc1ccaa47b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:33Z,use_quota=True,user_id='09084b2e29b845118c87e5eb4d3599a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f88eb1c3-198a-42c9-9db9-07ab0873c172),volume_type_id=f88eb1c3-198a-42c9-9db9-07ab0873c172)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92b22de-d36d-4f1a-9dfd-3d194f43f684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f92b22de-d36d-4f1a-9dfd-3d194f43f684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1900002b-13f7-41b9-a6f1-d7c99fe55f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1900002b-13f7-41b9-a6f1-d7c99fe55f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d43fa16-a324-4289-8ffa-b12bc200f0cd', 'volume_name': 'volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605aac9b-d7e8-4170-bc8d-f03c25a86101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (605aac9b-d7e8-4170-bc8d-f03c25a86101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5341d55-b5e1-452f-90d1-9620c1e4397a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:33 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Volume 1d43fa16-a324-4289-8ffa-b12bc200f0cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd', 'volume_size': 1}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:33 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] Deleted volume successfully.
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-968118e6-d62f-4a75-abdc-73ef1d5c81da tempest-VolumesActionsTest-622136765 None] Lock "cinder-f645cb7a-f62a-4be5-b1e9-1b92d7c09da3-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:33 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c" returned: 0 in 0.506s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.152s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a48299f3-4c1f-4d75-80f1-a20b557041ff,created_at=2026-08-12T14:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-986520305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a48299f3-4c1f-4d75-80f1-a20b557041ff,host='devstack@QuobyteHD#QuobyteHD',id=1d43fa16-a324-4289-8ffa-b12bc200f0cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75c9057fa5a4409a5333acc1ccaa47b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:33Z,use_quota=True,user_id='09084b2e29b845118c87e5eb4d3599a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f88eb1c3-198a-42c9-9db9-07ab0873c172),volume_type_id=f88eb1c3-198a-42c9-9db9-07ab0873c172)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Creating volume 1d43fa16-a324-4289-8ffa-b12bc200f0cd {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:25:33 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55927003-0dd5-4462-aca8-bc260f2c5543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f7dfdb-dce8-403f-b834-c97701d3708c', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba034ed-5699-4dce-a178-ddc7bb5e6df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:33 devstack sudo[102714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd 1073741824
Aug 12 16:25:33 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:33 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Volume volume-23f7dfdb-dce8-403f-b834-c97701d3708c (23f7dfdb-dce8-403f-b834-c97701d3708c): created successfully
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ba034ed-5699-4dce-a178-ddc7bb5e6df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Flow 'volume_create_manager' (75db4466-cc07-4c62-939b-98261c73f948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:33 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-7bc47d34-c3ec-489d-b9bd-7facd2e9f310 tempest-VolumesGetTest-1084562085 None] Created volume successfully.
Aug 12 16:25:34 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd 1073741824" returned: 0 in 0.864s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:34 devstack sudo[102763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd
Aug 12 16:25:34 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:35 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd" returned: 0 in 0.511s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:25:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5341d55-b5e1-452f-90d1-9620c1e4397a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e87234-f1f7-4a08-a890-fcf596b3059c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:35 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Volume volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd (1d43fa16-a324-4289-8ffa-b12bc200f0cd): created successfully
Aug 12 16:25:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e87234-f1f7-4a08-a890-fcf596b3059c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Flow 'volume_create_manager' (2fed6673-d191-4e79-895d-8e0112943ca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:35 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-b39a9821-150a-40cb-bb4d-f97822df1fd4 tempest-GroupSnapshotsTest-2118143769 None] Created volume successfully.
Aug 12 16:25:35 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:25:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Flow 'volume_create_manager' (366d2e4f-4ade-4ffb-9be4-fc2da9e89145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d739bb-314d-4d02-8d72-9f00306bd964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d739bb-314d-4d02-8d72-9f00306bd964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-211667492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aecffa7-5ecd-4eef-8750-78b4e500c058,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a1b4918891974a0ca191d943f87c3a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=23f7dfdb-dce8-403f-b834-c97701d3708c,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:36Z,use_quota=True,user_id='b76ae204362a4388b2f3acaf63a4f842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8649124c-873a-4ee7-8f7a-41867d63503e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8649124c-873a-4ee7-8f7a-41867d63503e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d97d3c-82b1-4281-80e1-658959b0c37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d97d3c-82b1-4281-80e1-658959b0c37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2aecffa7-5ecd-4eef-8750-78b4e500c058', 'volume_name': 'volume-2aecffa7-5ecd-4eef-8750-78b4e500c058', 'volume_size': 1, 'source_volid': '23f7dfdb-dce8-403f-b834-c97701d3708c', 'source_volstatus': 'available'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3332ca-8f78-4f40-b0de-8dc56aaac9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3332ca-8f78-4f40-b0de-8dc56aaac9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093ce2a4-a740-4b07-b0da-2f87e28fae19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:36 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Volume 2aecffa7-5ecd-4eef-8750-78b4e500c058: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2aecffa7-5ecd-4eef-8750-78b4e500c058', 'volume_size': 1, 'source_volid': '23f7dfdb-dce8-403f-b834-c97701d3708c', 'source_volstatus': 'available'}
Aug 12 16:25:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:36 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Cloning volume 23f7dfdb-dce8-403f-b834-c97701d3708c to volume 2aecffa7-5ecd-4eef-8750-78b4e500c058
Aug 12 16:25:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Creating offline snapshot adaebfcb-aea4-4afd-9a74-27206ed62b90 of volume 23f7dfdb-dce8-403f-b834-c97701d3708c {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:25:36 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[796f5b59-2b43-4cb9-b531-637fffa5dbcd]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:36 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] GroupSnapshot 123706e4-4502-4b02-b8ad-706d96dfc5dc: creating.
Aug 12 16:25:36 devstack sudo[102830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c
Aug 12 16:25:36 devstack sudo[102830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] Group snapshot 123706e4-4502-4b02-b8ad-706d96dfc5dc: creating. {{(pid=94457) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 12 16:25:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:36 devstack sudo[102830]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c" returned: 0 in 0.628s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:36 devstack sudo[102836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90 1G
Aug 12 16:25:36 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:37 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90 1G" returned: 0 in 0.642s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23f7dfdb-dce8-403f-b834-c97701d3708c -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:37 devstack sudo[102844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23f7dfdb-dce8-403f-b834-c97701d3708c -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90
Aug 12 16:25:37 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:38 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23f7dfdb-dce8-403f-b834-c97701d3708c -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90" returned: 0 in 0.448s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:38 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90 is being set with open permissions: ugo+rw
Aug 12 16:25:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:38 devstack sudo[102851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90
Aug 12 16:25:38 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:38 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90" returned: 0 in 0.261s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:38 devstack sudo[102854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.info
Aug 12 16:25:38 devstack sudo[102854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:38 devstack sudo[102854]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.info" returned: 0 in 0.255s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:38 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.info is being set with open permissions: ugo+rw
Aug 12 16:25:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:38 devstack sudo[102857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.info
Aug 12 16:25:38 devstack sudo[102857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:38 devstack sudo[102857]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.info" returned: 0 in 0.251s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Acquiring lock "cinder-quobyte-2aecffa7-5ecd-4eef-8750-78b4e500c058" by "_copy_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Lock "cinder-quobyte-2aecffa7-5ecd-4eef-8750-78b4e500c058" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] snapshot: adaebfcb-aea4-4afd-9a74-27206ed62b90, volume: 2aecffa7-5ecd-4eef-8750-78b4e500c058,  {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 12 16:25:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:38 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3e5cf0-e8d3-4c5d-8657-2a9d39abf832]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:39 devstack sudo[102860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90
Aug 12 16:25:39 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:39 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90" returned: 0 in 0.411s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23f7dfdb-dce8-403f-b834-c97701d3708c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf27d52-7b31-4cb8-8c79-a418c1050a42]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:39 devstack sudo[102865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c
Aug 12 16:25:39 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Flow 'volume_create_manager' (68deb294-e913-4b8a-9d47-aac448ae67e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28de5500-a1af-420c-8558-f7704bc5b801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28de5500-a1af-420c-8558-f7704bc5b801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1008025138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a1eba2-1b27-4b29-9142-d736657b3053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea567aa363ad4885a0aaa0c38f9c9fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:40Z,use_quota=True,user_id='602e329e842a453fb753e66788b52fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e6bcc7-e661-44c1-b30b-3e8e2d83f036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30e6bcc7-e661-44c1-b30b-3e8e2d83f036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8114fc-34c7-45ed-b6f0-a8209ed580b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec8114fc-34c7-45ed-b6f0-a8209ed580b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21a1eba2-1b27-4b29-9142-d736657b3053', 'volume_name': 'volume-21a1eba2-1b27-4b29-9142-d736657b3053', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250ce032-cda2-4565-a8fc-4a3ef098463e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (250ce032-cda2-4565-a8fc-4a3ef098463e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba4fbb9-2eb2-46af-a906-8a2ffcaab8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:39 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Volume 21a1eba2-1b27-4b29-9142-d736657b3053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21a1eba2-1b27-4b29-9142-d736657b3053', 'volume_size': 1}
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:39 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c" returned: 0 in 0.504s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Creating direct copy from snapshot {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG cinder.utils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Path /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2aecffa7-5ecd-4eef-8750-78b4e500c058 not found in is_blk_device check {{(pid=94457) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 12 16:25:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2aecffa7-5ecd-4eef-8750-78b4e500c058 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:39 devstack sudo[102871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2aecffa7-5ecd-4eef-8750-78b4e500c058
Aug 12 16:25:39 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:45 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2aecffa7-5ecd-4eef-8750-78b4e500c058" returned: 0 in 5.191s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:45 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c, size 1024.00 MB, duration 5.19 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2aecffa7-5ecd-4eef-8750-78b4e500c058 {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:25:45 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Converted 1024.00 MB image at 197.20 MB/s
Aug 12 16:25:45 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2aecffa7-5ecd-4eef-8750-78b4e500c058 is being set with open permissions: ugo+rw
Aug 12 16:25:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2aecffa7-5ecd-4eef-8750-78b4e500c058 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:45 devstack sudo[102886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2aecffa7-5ecd-4eef-8750-78b4e500c058
Aug 12 16:25:45 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:45 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2aecffa7-5ecd-4eef-8750-78b4e500c058" returned: 0 in 0.255s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Lock "cinder-quobyte-2aecffa7-5ecd-4eef-8750-78b4e500c058" released by "_copy_volume_from_snapshot" :: held 6.435s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Acquiring lock "cinder-quobyte-adaebfcb-aea4-4afd-9a74-27206ed62b90" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Lock "cinder-quobyte-adaebfcb-aea4-4afd-9a74-27206ed62b90" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Deleting offline snapshot adaebfcb-aea4-4afd-9a74-27206ed62b90 of volume 23f7dfdb-dce8-403f-b834-c97701d3708c {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:25:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] snapshot_file for this snap is: volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:25:45 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d469d4e6-7bb5-4480-986f-2b80f2cdd10a]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:45 devstack sudo[102889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90
Aug 12 16:25:45 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:45 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90" returned: 0 in 0.355s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23f7dfdb-dce8-403f-b834-c97701d3708c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:25:45 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9ddf83-87ac-4281-9331-c5baa9947c51]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:45 devstack sudo[102894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c
Aug 12 16:25:45 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:46 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c" returned: 0 in 0.534s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:46 devstack sudo[102899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90
Aug 12 16:25:46 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:46 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90" returned: 0 in 0.328s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:46 devstack sudo[102904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90
Aug 12 16:25:46 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:46 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c.adaebfcb-aea4-4afd-9a74-27206ed62b90" returned: 0 in 0.238s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Lock "cinder-quobyte-adaebfcb-aea4-4afd-9a74-27206ed62b90" released by "_delete_snapshot" :: held 1.540s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.679s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.321s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093ce2a4-a740-4b07-b0da-2f87e28fae19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aecffa7-5ecd-4eef-8750-78b4e500c058', 'volume_size': 1, 'source_volid': '23f7dfdb-dce8-403f-b834-c97701d3708c', 'source_volstatus': 'available'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (070257b0-82cc-4f0a-a43a-bb57245a90fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] Creating offline snapshot ef57fcd9-3304-423c-bcea-cda20abca9e6 of volume 1d43fa16-a324-4289-8ffa-b12bc200f0cd {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:25:46 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Volume volume-2aecffa7-5ecd-4eef-8750-78b4e500c058 (2aecffa7-5ecd-4eef-8750-78b4e500c058): created successfully
Aug 12 16:25:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (070257b0-82cc-4f0a-a43a-bb57245a90fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Flow 'volume_create_manager' (366d2e4f-4ade-4ffb-9be4-fc2da9e89145) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:46 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1994e8-d614-4323-8e5b-f7ed01959d00]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:47 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-69b5144f-9805-4378-8b9e-2879eca47b89 tempest-VolumesGetTest-1084562085 None] Created volume successfully.
Aug 12 16:25:47 devstack sudo[102907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd
Aug 12 16:25:47 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:47 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd" returned: 0 in 0.457s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:47 devstack sudo[102913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6 1G
Aug 12 16:25:47 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:47 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6 1G" returned: 0 in 0.487s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:47 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:25:47 devstack sudo[102919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6
Aug 12 16:25:47 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Flow 'volume_create_manager' (f1a78d79-af70-46e6-83bf-4bd31849f8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a4a35c-f75c-4335-8795-acb6b0328215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6a4a35c-f75c-4335-8795-acb6b0328215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-190613885',display_name='tempest-VolumesGetTest-Volume-739693259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a366e7f0-545b-4df7-b9b8-7406d284bd34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b4918891974a0ca191d943f87c3a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:48Z,use_quota=True,user_id='b76ae204362a4388b2f3acaf63a4f842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfd7db9-9992-415c-be69-190c6f4b6dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfd7db9-9992-415c-be69-190c6f4b6dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f462ea52-b8cd-4192-ada3-dde0d6ab17b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f462ea52-b8cd-4192-ada3-dde0d6ab17b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a366e7f0-545b-4df7-b9b8-7406d284bd34', 'volume_name': 'volume-a366e7f0-545b-4df7-b9b8-7406d284bd34', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ce666d-d872-49f6-af75-60ff8953eae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30ce666d-d872-49f6-af75-60ff8953eae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9cf73e6-c45c-4a0e-a053-26dfbe261191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:48 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Volume a366e7f0-545b-4df7-b9b8-7406d284bd34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a366e7f0-545b-4df7-b9b8-7406d284bd34', 'volume_size': 1}
Aug 12 16:25:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:48 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6" returned: 0 in 0.302s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:48 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6 is being set with open permissions: ugo+rw: NotImplementedError
Aug 12 16:25:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:48 devstack sudo[102924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6
Aug 12 16:25:48 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:48 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6" returned: 0 in 0.253s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:48 devstack sudo[102927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.info
Aug 12 16:25:48 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:48 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.info" returned: 0 in 0.259s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:48 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 12 16:25:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:48 devstack sudo[102930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.info
Aug 12 16:25:48 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:49 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.info" returned: 0 in 0.262s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.119s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.250s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1008025138',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a1eba2-1b27-4b29-9142-d736657b3053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea567aa363ad4885a0aaa0c38f9c9fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:40Z,use_quota=True,user_id='602e329e842a453fb753e66788b52fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Creating volume 21a1eba2-1b27-4b29-9142-d736657b3053 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:25:49 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21a1eba2-1b27-4b29-9142-d736657b3053 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:49 devstack sudo[102933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21a1eba2-1b27-4b29-9142-d736657b3053 1073741824
Aug 12 16:25:49 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:49 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5e8bb6aa-989a-4a59-a7d6-9427e54da633 tempest-GroupSnapshotsTest-2118143769 None] group_snapshot 123706e4-4502-4b02-b8ad-706d96dfc5dc: created successfully
Aug 12 16:25:49 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21a1eba2-1b27-4b29-9142-d736657b3053 1073741824" returned: 0 in 0.459s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21a1eba2-1b27-4b29-9142-d736657b3053 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:49 devstack sudo[102939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21a1eba2-1b27-4b29-9142-d736657b3053
Aug 12 16:25:49 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:49 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21a1eba2-1b27-4b29-9142-d736657b3053" returned: 0 in 0.285s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.831s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-190613885',display_name='tempest-VolumesGetTest-Volume-739693259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a366e7f0-545b-4df7-b9b8-7406d284bd34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b4918891974a0ca191d943f87c3a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:48Z,use_quota=True,user_id='b76ae204362a4388b2f3acaf63a4f842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Creating volume a366e7f0-545b-4df7-b9b8-7406d284bd34 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:25:49 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a366e7f0-545b-4df7-b9b8-7406d284bd34 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ba4fbb9-2eb2-46af-a906-8a2ffcaab8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21a1eba2-1b27-4b29-9142-d736657b3053', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:49 devstack sudo[102943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a366e7f0-545b-4df7-b9b8-7406d284bd34 1073741824
Aug 12 16:25:49 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8986be5e-e0bd-48e5-8843-d57b25196c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:49 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Volume volume-21a1eba2-1b27-4b29-9142-d736657b3053 (21a1eba2-1b27-4b29-9142-d736657b3053): created successfully
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8986be5e-e0bd-48e5-8843-d57b25196c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Flow 'volume_create_manager' (68deb294-e913-4b8a-9d47-aac448ae67e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:49 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-6f05bf2c-7035-4e2c-b79f-e377768eca4b tempest-VolumesActionsTest-622136765 None] Created volume successfully.
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:50 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a366e7f0-545b-4df7-b9b8-7406d284bd34 1073741824" returned: 0 in 0.507s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a366e7f0-545b-4df7-b9b8-7406d284bd34 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:50 devstack sudo[102951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a366e7f0-545b-4df7-b9b8-7406d284bd34
Aug 12 16:25:50 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:50 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a366e7f0-545b-4df7-b9b8-7406d284bd34" returned: 0 in 0.258s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.522s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "cinder-quobyte-ef57fcd9-3304-423c-bcea-cda20abca9e6-bd383bb2-ac27-4884-8cb3-3e466680161b" by "_create_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9cf73e6-c45c-4a0e-a053-26dfbe261191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a366e7f0-545b-4df7-b9b8-7406d284bd34', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd354e15-9dea-4a04-94fc-f9f2af3e33f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-ef57fcd9-3304-423c-bcea-cda20abca9e6-bd383bb2-ac27-4884-8cb3-3e466680161b" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Creating volume bd383bb2-ac27-4884-8cb3-3e466680161b from snapshot ef57fcd9-3304-423c-bcea-cda20abca9e6 {{(pid=94457) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "cinder-quobyte-bd383bb2-ac27-4884-8cb3-3e466680161b" by "_copy_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:50 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Volume volume-a366e7f0-545b-4df7-b9b8-7406d284bd34 (a366e7f0-545b-4df7-b9b8-7406d284bd34): created successfully
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd354e15-9dea-4a04-94fc-f9f2af3e33f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Flow 'volume_create_manager' (f1a78d79-af70-46e6-83bf-4bd31849f8f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-bd383bb2-ac27-4884-8cb3-3e466680161b" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] snapshot: ef57fcd9-3304-423c-bcea-cda20abca9e6, volume: bd383bb2-ac27-4884-8cb3-3e466680161b,  {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 12 16:25:50 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c553fb9f-c0ca-4f96-9a2d-52b6d1a83ead tempest-VolumesGetTest-1084562085 None] Created volume successfully.
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad74eb7e-1824-4f90-b4cc-ee6c9de936ea]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] Acquiring lock "cinder-21a1eba2-1b27-4b29-9142-d736657b3053-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] Lock "cinder-21a1eba2-1b27-4b29-9142-d736657b3053-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] Acquiring lock "cinder-quobyte-21a1eba2-1b27-4b29-9142-d736657b3053" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:50 devstack sudo[102960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6
Aug 12 16:25:50 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] Lock "cinder-quobyte-21a1eba2-1b27-4b29-9142-d736657b3053" acquired by "delete_volume" :: waited 0.020s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea169b0d-0cb1-4e35-86ac-3a84767a7173]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21a1eba2-1b27-4b29-9142-d736657b3053 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:51 devstack sudo[102965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21a1eba2-1b27-4b29-9142-d736657b3053
Aug 12 16:25:51 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] Acquiring lock "cinder-a366e7f0-545b-4df7-b9b8-7406d284bd34-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] Lock "cinder-a366e7f0-545b-4df7-b9b8-7406d284bd34-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] Acquiring lock "cinder-quobyte-a366e7f0-545b-4df7-b9b8-7406d284bd34" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] Lock "cinder-quobyte-a366e7f0-545b-4df7-b9b8-7406d284bd34" acquired by "delete_volume" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:51 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6" returned: 0 in 0.549s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[9520dd3b-8c42-4903-9742-6d311647a32e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a366e7f0-545b-4df7-b9b8-7406d284bd34 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ce408e-8515-4c33-9a4e-dfadc40f0bc0]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:51 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21a1eba2-1b27-4b29-9142-d736657b3053" returned: 0 in 0.487s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21a1eba2-1b27-4b29-9142-d736657b3053 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:51 devstack sudo[102972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a366e7f0-545b-4df7-b9b8-7406d284bd34
Aug 12 16:25:51 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:51 devstack sudo[102973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd
Aug 12 16:25:51 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:51 devstack sudo[102977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21a1eba2-1b27-4b29-9142-d736657b3053
Aug 12 16:25:51 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:51 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21a1eba2-1b27-4b29-9142-d736657b3053" returned: 0 in 0.275s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:51 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a366e7f0-545b-4df7-b9b8-7406d284bd34" returned: 0 in 0.396s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a366e7f0-545b-4df7-b9b8-7406d284bd34 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:51 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] Lock "cinder-quobyte-21a1eba2-1b27-4b29-9142-d736657b3053" released by "delete_volume" :: held 0.833s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd" returned: 0 in 0.405s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Creating direct copy from snapshot {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG cinder.utils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Path /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bd383bb2-ac27-4884-8cb3-3e466680161b not found in is_blk_device check {{(pid=94457) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bd383bb2-ac27-4884-8cb3-3e466680161b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:51 devstack sudo[102990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a366e7f0-545b-4df7-b9b8-7406d284bd34
Aug 12 16:25:51 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:51 devstack sudo[102992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bd383bb2-ac27-4884-8cb3-3e466680161b
Aug 12 16:25:51 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] Created reservations ['b1bb9929-12b9-4a9e-8510-41ad0b6ba2b8', 'e1f1a2be-67fa-4c4d-98f7-e6ce01fc4a91', '0adf2ffb-88c3-4c5c-aca8-043da8027001', 'b5212fdc-0cc5-4f5a-b555-bedfc0e31cbe'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:51 devstack sudo[102994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:25:51 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:52 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a366e7f0-545b-4df7-b9b8-7406d284bd34" returned: 0 in 0.300s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:52 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] Lock "cinder-quobyte-a366e7f0-545b-4df7-b9b8-7406d284bd34" released by "delete_volume" :: held 0.748s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:52 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] Created reservations ['add7b12b-5c5d-49ef-ad0e-37c8b34a82c0', '035c39cd-a46b-4945-85af-8a1cedebe4ca', '2c71c4fa-167b-4fe2-a91a-8fb8e75830d7', '0bbe7bef-a948-43b5-95b2-3de8c59f0be2'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:25:52 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.301s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:52 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:25:52 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] Deleted volume successfully.
Aug 12 16:25:52 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-04e2c464-bb81-4d47-a154-ae0f0e7bd847 tempest-VolumesActionsTest-1355229510 None] Lock "cinder-21a1eba2-1b27-4b29-9142-d736657b3053-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:52 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:52 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:52 devstack sudo[103002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:25:52 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:52 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] Acquiring lock "cinder-2aecffa7-5ecd-4eef-8750-78b4e500c058-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:52 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] Lock "cinder-2aecffa7-5ecd-4eef-8750-78b4e500c058-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:53 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.690s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:53 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:25:53 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] Deleted volume successfully.
Aug 12 16:25:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f092e61a-7676-41e9-883d-291a79d672d3 tempest-VolumesGetTest-1084562085 None] Lock "cinder-a366e7f0-545b-4df7-b9b8-7406d284bd34-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] Acquiring lock "cinder-quobyte-2aecffa7-5ecd-4eef-8750-78b4e500c058" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] Lock "cinder-quobyte-2aecffa7-5ecd-4eef-8750-78b4e500c058" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:53 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8f4b83-9401-4a73-9667-ad0077b2e643]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2aecffa7-5ecd-4eef-8750-78b4e500c058 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:53 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:25:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Flow 'volume_create_manager' (b4457206-6603-46b9-84bf-33528015a8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6fc8443-1ab1-4cfd-9411-d5ab513f86cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6fc8443-1ab1-4cfd-9411-d5ab513f86cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2004896986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d16a40-0864-4254-8b1a-1fc5dea82d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea567aa363ad4885a0aaa0c38f9c9fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:53Z,use_quota=True,user_id='602e329e842a453fb753e66788b52fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b1e607-c339-4fe5-adec-97fb0c6eed02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b1e607-c339-4fe5-adec-97fb0c6eed02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5db57e1-b6a1-4c3a-bcd0-5eb192a2e076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5db57e1-b6a1-4c3a-bcd0-5eb192a2e076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63d16a40-0864-4254-8b1a-1fc5dea82d9a', 'volume_name': 'volume-63d16a40-0864-4254-8b1a-1fc5dea82d9a', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17bf27e-9f8c-47f0-ad65-6b7153f9fc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f17bf27e-9f8c-47f0-ad65-6b7153f9fc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e01d3b-51ac-4168-ab84-f4f8b354b96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:53 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Volume 63d16a40-0864-4254-8b1a-1fc5dea82d9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63d16a40-0864-4254-8b1a-1fc5dea82d9a', 'volume_size': 1}
Aug 12 16:25:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:53 devstack sudo[103011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2aecffa7-5ecd-4eef-8750-78b4e500c058
Aug 12 16:25:53 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:54 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2aecffa7-5ecd-4eef-8750-78b4e500c058" returned: 0 in 0.888s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2aecffa7-5ecd-4eef-8750-78b4e500c058 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:54 devstack sudo[103018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2aecffa7-5ecd-4eef-8750-78b4e500c058
Aug 12 16:25:54 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:54 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2aecffa7-5ecd-4eef-8750-78b4e500c058" returned: 0 in 0.541s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:54 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] Lock "cinder-quobyte-2aecffa7-5ecd-4eef-8750-78b4e500c058" released by "delete_volume" :: held 1.538s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:54 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] Created reservations ['ca4a92d1-cbb3-4270-8908-2446e9d6127f', 'a9d2e302-66d2-4c15-ba4c-34eda51b55b0', 'cc34115b-b74b-487e-87c8-ed316d882550', 'f58c551b-2993-4985-baa1-811e5e804d16'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:25:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:54 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:54 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:54 devstack sudo[103021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:25:54 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:55 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.324s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:55 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:25:55 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] Deleted volume successfully.
Aug 12 16:25:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-70085fc1-984a-450c-ba4d-bbc8adf8aa0d tempest-VolumesGetTest-1084562085 None] Lock "cinder-2aecffa7-5ecd-4eef-8750-78b4e500c058-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] Acquiring lock "cinder-23f7dfdb-dce8-403f-b834-c97701d3708c-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] Lock "cinder-23f7dfdb-dce8-403f-b834-c97701d3708c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] Acquiring lock "cinder-quobyte-23f7dfdb-dce8-403f-b834-c97701d3708c" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] Lock "cinder-quobyte-23f7dfdb-dce8-403f-b834-c97701d3708c" acquired by "delete_volume" :: waited 0.035s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:56 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc286b9-c11f-41d4-a82f-858d8a3a2d5c]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:56 devstack sudo[103024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c
Aug 12 16:25:56 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:57 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c" returned: 0 in 1.051s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:57 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bd383bb2-ac27-4884-8cb3-3e466680161b" returned: 0 in 5.249s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bd383bb2-ac27-4884-8cb3-3e466680161b {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:25:57 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Converted 1024.00 MB image at 195.00 MB/s
Aug 12 16:25:57 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bd383bb2-ac27-4884-8cb3-3e466680161b is being set with open permissions: ugo+rw: NotImplementedError
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bd383bb2-ac27-4884-8cb3-3e466680161b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:57 devstack sudo[103029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c
Aug 12 16:25:57 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:57 devstack sudo[103030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bd383bb2-ac27-4884-8cb3-3e466680161b
Aug 12 16:25:57 devstack sudo[103030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:57 devstack sudo[103030]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:57 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23f7dfdb-dce8-403f-b834-c97701d3708c" returned: 0 in 0.276s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bd383bb2-ac27-4884-8cb3-3e466680161b" returned: 0 in 0.279s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-bd383bb2-ac27-4884-8cb3-3e466680161b" released by "_copy_volume_from_snapshot" :: held 6.607s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] Lock "cinder-quobyte-23f7dfdb-dce8-403f-b834-c97701d3708c" released by "delete_volume" :: held 1.445s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-ef57fcd9-3304-423c-bcea-cda20abca9e6-bd383bb2-ac27-4884-8cb3-3e466680161b" released by "_create_volume_from_snapshot" :: held 6.759s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.803s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.117s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2004896986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63d16a40-0864-4254-8b1a-1fc5dea82d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea567aa363ad4885a0aaa0c38f9c9fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:53Z,use_quota=True,user_id='602e329e842a453fb753e66788b52fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Creating volume 63d16a40-0864-4254-8b1a-1fc5dea82d9a {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:25:57 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-63d16a40-0864-4254-8b1a-1fc5dea82d9a 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] Created reservations ['267b88f1-429a-4094-86ff-681d5f1ddb8d', '5e2d4ea4-b5c3-4aee-8ce8-d943d54923f1', '3dd30576-0350-4f98-802b-c36ba5f6806b', '28af3be5-024d-4b94-814b-a81673b29486'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:25:57 devstack sudo[103035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-63d16a40-0864-4254-8b1a-1fc5dea82d9a 1073741824
Aug 12 16:25:57 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:57 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-44131e86-4ddc-4d10-ad82-7b19391530c9 tempest-GroupSnapshotsTest-2118143769 None] Create group from source-snapshot-123706e4-4502-4b02-b8ad-706d96dfc5dc completed successfully.
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:57 devstack sudo[103037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:25:57 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:57 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.269s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:25:57 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] Deleted volume successfully.
Aug 12 16:25:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-fef6ec3b-587a-4dee-a82e-1c2f5aeb09df tempest-VolumesGetTest-1084562085 None] Lock "cinder-23f7dfdb-dce8-403f-b834-c97701d3708c-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:58 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-63d16a40-0864-4254-8b1a-1fc5dea82d9a 1073741824" returned: 0 in 0.512s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-63d16a40-0864-4254-8b1a-1fc5dea82d9a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:58 devstack sudo[103044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-63d16a40-0864-4254-8b1a-1fc5dea82d9a
Aug 12 16:25:58 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:58 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-63d16a40-0864-4254-8b1a-1fc5dea82d9a" returned: 0 in 0.281s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1e01d3b-51ac-4168-ab84-f4f8b354b96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63d16a40-0864-4254-8b1a-1fc5dea82d9a', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01166447-9518-47ad-aa26-eae1fbbef083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:58 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Volume volume-63d16a40-0864-4254-8b1a-1fc5dea82d9a (63d16a40-0864-4254-8b1a-1fc5dea82d9a): created successfully
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01166447-9518-47ad-aa26-eae1fbbef083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Flow 'volume_create_manager' (b4457206-6603-46b9-84bf-33528015a8ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:58 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-012f40e7-cdd1-4dfa-a826-b5b9040959b3 tempest-VolumesActionsTest-622136765 None] Created volume successfully.
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "cinder-quobyte-bd383bb2-ac27-4884-8cb3-3e466680161b" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-bd383bb2-ac27-4884-8cb3-3e466680161b" acquired by "delete_volume" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7780a63-f8a0-46bf-9c00-b559114af271]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bd383bb2-ac27-4884-8cb3-3e466680161b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:58 devstack sudo[103047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bd383bb2-ac27-4884-8cb3-3e466680161b
Aug 12 16:25:58 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Flow 'volume_create_manager' (d2e4c3d4-b0a7-47d9-b9ed-ba30d2ed4707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f76e828-9cbd-4848-b3c7-cd8f9381584a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f76e828-9cbd-4848-b3c7-cd8f9381584a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1845002409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1998d562-0e95-4f39-a548-5d79bb33b674,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a1b4918891974a0ca191d943f87c3a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:59Z,use_quota=True,user_id='b76ae204362a4388b2f3acaf63a4f842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aad1db7-2a6d-48f7-ada5-7aee6f063ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aad1db7-2a6d-48f7-ada5-7aee6f063ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a598648-9099-4aed-b4b8-074a9fb9cbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:58 devstack cinder-volume[94457]: DEBUG cinder.image.glance [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Creating Keystone auth plugin from conf {{(pid=94457) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 12 16:25:59 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bd383bb2-ac27-4884-8cb3-3e466680161b" returned: 0 in 0.376s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bd383bb2-ac27-4884-8cb3-3e466680161b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:59 devstack sudo[103052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bd383bb2-ac27-4884-8cb3-3e466680161b
Aug 12 16:25:59 devstack sudo[103052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a598648-9099-4aed-b4b8-074a9fb9cbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1998d562-0e95-4f39-a548-5d79bb33b674', 'volume_name': 'volume-1998d562-0e95-4f39-a548-5d79bb33b674', 'volume_size': 1, 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b7d6f6e2f82493fb2262e877eaef313', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'created_at': datetime.datetime(2026, 8, 12, 14, 14, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 14, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86433006-753f-43b5-b60e-7f6f6c1c77c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b634608f0>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de349acb-24d0-41e3-bea5-9238ae8a00b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de349acb-24d0-41e3-bea5-9238ae8a00b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d93e8ef-ef0c-403d-aea1-4cb535c93935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:25:59 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Volume 1998d562-0e95-4f39-a548-5d79bb33b674: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1998d562-0e95-4f39-a548-5d79bb33b674', 'volume_size': 1, 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b7d6f6e2f82493fb2262e877eaef313', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'created_at': datetime.datetime(2026, 8, 12, 14, 14, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 14, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86433006-753f-43b5-b60e-7f6f6c1c77c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b634608f0>}
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Trying to clone 1998d562-0e95-4f39-a548-5d79bb33b674 from image 86433006-753f-43b5-b60e-7f6f6c1c77c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]). {{(pid=94457) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 12 16:25:59 devstack sudo[103052]: pam_unix(sudo:session): session closed for user root
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bd383bb2-ac27-4884-8cb3-3e466680161b" returned: 0 in 0.264s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-bd383bb2-ac27-4884-8cb3-3e466680161b" released by "delete_volume" :: held 0.703s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] Created reservations ['38b1dfce-1796-4b15-99e8-2d86467d8270'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:25:59 devstack cinder-volume[94457]: WARNING cinder.quota [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-462171876 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-462171876, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:25:59 devstack cinder-volume[94457]: WARNING cinder.quota [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-462171876 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-462171876, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_bc20rmacdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 12 16:25:59 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Image download 20.69 MB at 20.69 MB/s
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] Created reservations ['19af0c28-15bb-45e1-b25c-8c68e4781edf', '617b02b7-43cd-40d4-9f5e-5247fb682c1b', 'e80c7723-b761-4d4a-80b2-de0dfb76129d', '76edf2e8-66f5-423a-b8d6-994835540920'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba59d2a4-f097-4636-8c41-377b7bcce73e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_bc20rmacdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] Acquiring lock "cinder-63d16a40-0864-4254-8b1a-1fc5dea82d9a-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] Lock "cinder-63d16a40-0864-4254-8b1a-1fc5dea82d9a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] Acquiring lock "cinder-quobyte-63d16a40-0864-4254-8b1a-1fc5dea82d9a" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:25:59 devstack sudo[103057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_bc20rmacdevstack@QuobyteHD
Aug 12 16:25:59 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] Lock "cinder-quobyte-63d16a40-0864-4254-8b1a-1fc5dea82d9a" acquired by "delete_volume" :: waited 0.043s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:25:59 devstack sudo[103059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:25:59 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f751f3e-6808-4485-90b3-bd7000a11275]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:25:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-63d16a40-0864-4254-8b1a-1fc5dea82d9a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:00 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] group_snapshot 123706e4-4502-4b02-b8ad-706d96dfc5dc: deleting
Aug 12 16:26:00 devstack sudo[103061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-63d16a40-0864-4254-8b1a-1fc5dea82d9a
Aug 12 16:26:00 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:00 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_bc20rmacdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Temporary image 86433006-753f-43b5-b60e-7f6f6c1c77c6 is fetched for user b76ae204362a4388b2f3acaf63a4f842. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] group_snapshot 123706e4-4502-4b02-b8ad-706d96dfc5dc: deleting {{(pid=94457) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 12 16:26:00 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "cinder-quobyte-1d43fa16-a324-4289-8ffa-b12bc200f0cd" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.314s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:26:00 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-d83f97b6-3db1-4c5b-b24e-744c68207946 tempest-GroupSnapshotsTest-2118143769 None] Delete group completed successfully.
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-1d43fa16-a324-4289-8ffa-b12bc200f0cd" acquired by "delete_snapshot" :: waited 0.052s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "cinder-quobyte-ef57fcd9-3304-423c-bcea-cda20abca9e6" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-ef57fcd9-3304-423c-bcea-cda20abca9e6" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] Deleting offline snapshot ef57fcd9-3304-423c-bcea-cda20abca9e6 of volume 1d43fa16-a324-4289-8ffa-b12bc200f0cd {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] snapshot_file for this snap is: volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4526cc1-7998-4ff2-816b-f2fa45151613]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_bc20rmacdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2de4ec-54ba-4c57-9544-ac26ebd28cb1]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:00 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-63d16a40-0864-4254-8b1a-1fc5dea82d9a" returned: 0 in 0.530s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-63d16a40-0864-4254-8b1a-1fc5dea82d9a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:00 devstack sudo[103069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_bc20rmacdevstack@QuobyteHD
Aug 12 16:26:00 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:00 devstack sudo[103070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6
Aug 12 16:26:00 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:00 devstack sudo[103075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-63d16a40-0864-4254-8b1a-1fc5dea82d9a
Aug 12 16:26:00 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:00 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_bc20rmacdevstack@QuobyteHD" returned: 0 in 0.465s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1845002409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1998d562-0e95-4f39-a548-5d79bb33b674,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a1b4918891974a0ca191d943f87c3a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:25:59Z,use_quota=True,user_id='b76ae204362a4388b2f3acaf63a4f842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Creating volume 1998d562-0e95-4f39-a548-5d79bb33b674 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:26:00 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1998d562-0e95-4f39-a548-5d79bb33b674 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:00 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6" returned: 0 in 0.503s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:26:00 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:00 devstack sudo[103087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1998d562-0e95-4f39-a548-5d79bb33b674 1073741824
Aug 12 16:26:00 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-63d16a40-0864-4254-8b1a-1fc5dea82d9a" returned: 0 in 0.403s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[61659fac-b420-4ad9-9131-d8f3ac3d68e5]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:00 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] Lock "cinder-quobyte-63d16a40-0864-4254-8b1a-1fc5dea82d9a" released by "delete_volume" :: held 1.014s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] Created reservations ['e9b8afd8-46ed-41a2-a61b-1ed2c2f5954a', 'aa7dbee8-6cc2-4fd6-873c-688ce497ba5b', '67946a21-6dc1-472f-b6a2-8cd052c09502', 'ca330e6b-5f0a-44df-8e7f-72fc3f33bf2b'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:26:01 devstack sudo[103089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd
Aug 12 16:26:01 devstack sudo[103089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:01 devstack sudo[103101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:26:01 devstack sudo[103101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:01 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1998d562-0e95-4f39-a548-5d79bb33b674 1073741824" returned: 0 in 0.766s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1998d562-0e95-4f39-a548-5d79bb33b674 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:01 devstack sudo[103101]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.480s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:26:01 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] Deleted volume successfully.
Aug 12 16:26:01 devstack sudo[103121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1998d562-0e95-4f39-a548-5d79bb33b674
Aug 12 16:26:01 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-25486ed7-3f92-4ba3-88dc-08cfb2cfcb1c tempest-VolumesActionsTest-1355229510 None] Lock "cinder-63d16a40-0864-4254-8b1a-1fc5dea82d9a-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:01 devstack sudo[103089]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd" returned: 0 in 0.829s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:01 devstack sudo[103126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6
Aug 12 16:26:01 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:01 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1998d562-0e95-4f39-a548-5d79bb33b674" returned: 0 in 0.281s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Attempting download of 86433006-753f-43b5-b60e-7f6f6c1c77c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}])) to volume 1998d562-0e95-4f39-a548-5d79bb33b674. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba5c8e9-070d-4436-aefc-1e03cf9d2ad4]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_rfrs0kpq {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:02 devstack sudo[103129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_rfrs0kpq
Aug 12 16:26:02 devstack sudo[103129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:02 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6" returned: 0 in 0.543s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:02 devstack sudo[103134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6
Aug 12 16:26:02 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:02 devstack sudo[103129]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_rfrs0kpq" returned: 0 in 0.502s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_rfrs0kpq {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:26:02 devstack sudo[103139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_rfrs0kpq
Aug 12 16:26:02 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:02 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Flow 'volume_create_manager' (1e446761-d99f-4ef3-98f0-6474e44fc8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c66e720-9d9a-4b74-b310-8fcd9912ab8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd.ef57fcd9-3304-423c-bcea-cda20abca9e6" returned: 0 in 0.482s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c66e720-9d9a-4b74-b310-8fcd9912ab8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-301282570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e72585c-6e80-44ab-bc40-211b32bc6bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea567aa363ad4885a0aaa0c38f9c9fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:03Z,use_quota=True,user_id='602e329e842a453fb753e66788b52fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38bd1a4f-526b-44ec-a4d8-88bed2a47016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38bd1a4f-526b-44ec-a4d8-88bed2a47016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f4156c-6891-4b65-9abe-2dc1ec7828b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f4156c-6891-4b65-9abe-2dc1ec7828b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e72585c-6e80-44ab-bc40-211b32bc6bed', 'volume_name': 'volume-6e72585c-6e80-44ab-bc40-211b32bc6bed', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644b9974-e8d3-47bb-b399-3919aa52c452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (644b9974-e8d3-47bb-b399-3919aa52c452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280a4350-42de-42e9-9348-70b22a29494a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:02 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Volume 6e72585c-6e80-44ab-bc40-211b32bc6bed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e72585c-6e80-44ab-bc40-211b32bc6bed', 'volume_size': 1}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-301282570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e72585c-6e80-44ab-bc40-211b32bc6bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea567aa363ad4885a0aaa0c38f9c9fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:03Z,use_quota=True,user_id='602e329e842a453fb753e66788b52fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Creating volume 6e72585c-6e80-44ab-bc40-211b32bc6bed {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:26:02 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6e72585c-6e80-44ab-bc40-211b32bc6bed 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-ef57fcd9-3304-423c-bcea-cda20abca9e6" released by "_delete_snapshot" :: held 2.605s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:02 devstack sudo[103143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6e72585c-6e80-44ab-bc40-211b32bc6bed 1073741824
Aug 12 16:26:02 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-1d43fa16-a324-4289-8ffa-b12bc200f0cd" released by "delete_snapshot" :: held 2.653s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:02 devstack cinder-volume[94457]: WARNING cinder.quota [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-462171876 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-462171876, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:26:02 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_rfrs0kpq" returned: 1 in 0.464s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_rfrs0kpq' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccd40a8-a3d4-492e-bb1d-369ce5691297]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_bc20rmacdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:02 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] Created reservations ['3fbece86-b0ab-4adc-98d4-d4c410206500', '412e1252-0ac8-4d9f-bc4f-e0ad8680180d', '0dce2402-abfd-42cc-ab80-788c2878e1ef', 'a2c3979c-6134-4050-bfd6-ae944fdb6377'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:26:03 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5acbb5a2-f273-4a3c-992a-aa8bbf50d07f tempest-GroupSnapshotsTest-2118143769 None] group_snapshot 123706e4-4502-4b02-b8ad-706d96dfc5dc: deleted successfully
Aug 12 16:26:03 devstack sudo[103147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_bc20rmacdevstack@QuobyteHD
Aug 12 16:26:03 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:03 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_bc20rmacdevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:03 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] 86433006-753f-43b5-b60e-7f6f6c1c77c6 was qcow2, converting to qcow2 {{(pid=94457) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 12 16:26:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_bc20rmacdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1998d562-0e95-4f39-a548-5d79bb33b674 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:03 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:03 devstack sudo[103157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_bc20rmacdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1998d562-0e95-4f39-a548-5d79bb33b674
Aug 12 16:26:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6e72585c-6e80-44ab-bc40-211b32bc6bed 1073741824" returned: 0 in 0.592s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:03 devstack sudo[103157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6e72585c-6e80-44ab-bc40-211b32bc6bed {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:03 devstack sudo[103159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6e72585c-6e80-44ab-bc40-211b32bc6bed
Aug 12 16:26:03 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:03 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6e72585c-6e80-44ab-bc40-211b32bc6bed" returned: 0 in 0.286s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:26:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (280a4350-42de-42e9-9348-70b22a29494a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e72585c-6e80-44ab-bc40-211b32bc6bed', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555b94f5-4353-4f53-b173-21a16204dc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:03 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Volume volume-6e72585c-6e80-44ab-bc40-211b32bc6bed (6e72585c-6e80-44ab-bc40-211b32bc6bed): created successfully
Aug 12 16:26:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (555b94f5-4353-4f53-b173-21a16204dc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Flow 'volume_create_manager' (1e446761-d99f-4ef3-98f0-6474e44fc8c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:03 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-0fa53c04-5a0d-4a27-93d1-3d297745eeac tempest-VolumesActionsTest-622136765 None] Created volume successfully.
Aug 12 16:26:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7d0e3619-b1fc-41e1-8318-fca58d0a93bd tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "cinder-quobyte-1d43fa16-a324-4289-8ffa-b12bc200f0cd" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7d0e3619-b1fc-41e1-8318-fca58d0a93bd tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-1d43fa16-a324-4289-8ffa-b12bc200f0cd" acquired by "delete_volume" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:04 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7f7814-fd80-4b75-bf6b-46445c384d46]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d0e3619-b1fc-41e1-8318-fca58d0a93bd tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:04 devstack sudo[103167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd
Aug 12 16:26:04 devstack sudo[103167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:04 devstack sudo[103167]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d0e3619-b1fc-41e1-8318-fca58d0a93bd tempest-GroupSnapshotsTest-2118143769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd" returned: 0 in 0.415s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d0e3619-b1fc-41e1-8318-fca58d0a93bd tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:04 devstack sudo[103173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd
Aug 12 16:26:04 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:04 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d0e3619-b1fc-41e1-8318-fca58d0a93bd tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1d43fa16-a324-4289-8ffa-b12bc200f0cd" returned: 0 in 0.329s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7d0e3619-b1fc-41e1-8318-fca58d0a93bd tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-1d43fa16-a324-4289-8ffa-b12bc200f0cd" released by "delete_volume" :: held 0.825s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:04 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-7d0e3619-b1fc-41e1-8318-fca58d0a93bd tempest-GroupSnapshotsTest-2118143769 None] Created reservations ['0cd2ade1-8adf-4353-b97b-2c96b9cbb274'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:26:04 devstack cinder-volume[94457]: WARNING cinder.db.api [None req-7d0e3619-b1fc-41e1-8318-fca58d0a93bd tempest-GroupSnapshotsTest-2118143769 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-462171876']
Aug 12 16:26:04 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-7d0e3619-b1fc-41e1-8318-fca58d0a93bd tempest-GroupSnapshotsTest-2118143769 None] Created reservations ['d70dafd1-4731-4515-b520-cbae44c67f93', 'f7e80901-eb44-4656-9dce-c3cb2a123255', 'a85c334e-db38-447f-aa7d-e8ab27086da3', '52a02271-8a63-4830-9d49-f1516017cbca'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:26:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] Acquiring lock "cinder-6e72585c-6e80-44ab-bc40-211b32bc6bed-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] Lock "cinder-6e72585c-6e80-44ab-bc40-211b32bc6bed-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7d0e3619-b1fc-41e1-8318-fca58d0a93bd tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7d0e3619-b1fc-41e1-8318-fca58d0a93bd tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7d0e3619-b1fc-41e1-8318-fca58d0a93bd tempest-GroupSnapshotsTest-2118143769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7d0e3619-b1fc-41e1-8318-fca58d0a93bd tempest-GroupSnapshotsTest-2118143769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7d0e3619-b1fc-41e1-8318-fca58d0a93bd tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d0e3619-b1fc-41e1-8318-fca58d0a93bd tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] Acquiring lock "cinder-quobyte-6e72585c-6e80-44ab-bc40-211b32bc6bed" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] Lock "cinder-quobyte-6e72585c-6e80-44ab-bc40-211b32bc6bed" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:05 devstack sudo[103176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:26:05 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:05 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fc238f-f519-4a64-925d-59e63e262d19]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6e72585c-6e80-44ab-bc40-211b32bc6bed {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:05 devstack sudo[103178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6e72585c-6e80-44ab-bc40-211b32bc6bed
Aug 12 16:26:05 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:05 devstack sudo[103157]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_bc20rmacdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1998d562-0e95-4f39-a548-5d79bb33b674" returned: 0 in 2.234s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:05 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_bc20rmacdevstack@QuobyteHD, size 112.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1998d562-0e95-4f39-a548-5d79bb33b674 {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:26:05 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Converted 112.00 MB image at 50.04 MB/s
Aug 12 16:26:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1998d562-0e95-4f39-a548-5d79bb33b674 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:05 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d0e3619-b1fc-41e1-8318-fca58d0a93bd tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.489s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:05 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-7d0e3619-b1fc-41e1-8318-fca58d0a93bd tempest-GroupSnapshotsTest-2118143769 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:26:05 devstack sudo[103181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1998d562-0e95-4f39-a548-5d79bb33b674 1G
Aug 12 16:26:05 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-7d0e3619-b1fc-41e1-8318-fca58d0a93bd tempest-GroupSnapshotsTest-2118143769 None] Delete group completed successfully.
Aug 12 16:26:05 devstack sudo[103181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:05 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-21b198ed-f2c7-4359-b027-a5939a268581 tempest-GroupSnapshotsTest-2118143769 None] Group tempest-GroupSnapshotsTest-Group-468489118: creating
Aug 12 16:26:05 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-21b198ed-f2c7-4359-b027-a5939a268581 tempest-GroupSnapshotsTest-2118143769 None] Group tempest-GroupSnapshotsTest-Group-468489118: created successfully
Aug 12 16:26:05 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6e72585c-6e80-44ab-bc40-211b32bc6bed" returned: 0 in 0.602s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6e72585c-6e80-44ab-bc40-211b32bc6bed {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:05 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-21b198ed-f2c7-4359-b027-a5939a268581 tempest-GroupSnapshotsTest-2118143769 None] Create group completed successfully.
Aug 12 16:26:05 devstack sudo[103186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6e72585c-6e80-44ab-bc40-211b32bc6bed
Aug 12 16:26:05 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:06 devstack sudo[103181]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1998d562-0e95-4f39-a548-5d79bb33b674 1G" returned: 0 in 0.480s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Downloaded image 86433006-753f-43b5-b60e-7f6f6c1c77c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}])) to volume 1998d562-0e95-4f39-a548-5d79bb33b674 successfully. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Temporary image 86433006-753f-43b5-b60e-7f6f6c1c77c6 for user b76ae204362a4388b2f3acaf63a4f842 is deleted. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Marking volume 1998d562-0e95-4f39-a548-5d79bb33b674 as bootable. {{(pid=94457) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 12 16:26:06 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Copying metadata from image 86433006-753f-43b5-b60e-7f6f6c1c77c6 to 1998d562-0e95-4f39-a548-5d79bb33b674. {{(pid=94457) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Creating volume glance metadata for volume 1998d562-0e95-4f39-a548-5d79bb33b674 backed by image 86433006-753f-43b5-b60e-7f6f6c1c77c6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94457) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6e72585c-6e80-44ab-bc40-211b32bc6bed" returned: 0 in 0.275s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] Lock "cinder-quobyte-6e72585c-6e80-44ab-bc40-211b32bc6bed" released by "delete_volume" :: held 0.944s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] Created reservations ['c7197a5a-0314-42df-96a9-78c7e35f93ba', '03594de9-df7f-4843-8733-3b69a684e7c1', '0376ff98-c002-4ada-ac25-fd64fd9d151a', '6389aa55-b432-4c79-9c08-952f85f8453d'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d93e8ef-ef0c-403d-aea1-4cb535c93935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1998d562-0e95-4f39-a548-5d79bb33b674', 'volume_size': 1, 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b7d6f6e2f82493fb2262e877eaef313', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'created_at': datetime.datetime(2026, 8, 12, 14, 14, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 14, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86433006-753f-43b5-b60e-7f6f6c1c77c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b634608f0>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3bc5d8a-ff8e-4c4e-ae4f-f786cd7bf4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:06 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Volume volume-1998d562-0e95-4f39-a548-5d79bb33b674 (1998d562-0e95-4f39-a548-5d79bb33b674): created successfully
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3bc5d8a-ff8e-4c4e-ae4f-f786cd7bf4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Flow 'volume_create_manager' (d2e4c3d4-b0a7-47d9-b9ed-ba30d2ed4707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:06 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-59ca5165-9d59-4d97-b841-6cd3a2b32bce tempest-VolumesGetTest-1084562085 None] Created volume successfully.
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:06 devstack sudo[103192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:26:06 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:06 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.258s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:26:06 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] Deleted volume successfully.
Aug 12 16:26:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7d256990-50e7-407c-aa46-56a5a59b4390 tempest-VolumesActionsTest-1355229510 None] Lock "cinder-6e72585c-6e80-44ab-bc40-211b32bc6bed-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Flow 'volume_create_manager' (98a61cde-9a86-4976-bc0d-fdb95a45e0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c25b74-9247-4a5f-95f2-a7e25d8035f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c25b74-9247-4a5f-95f2-a7e25d8035f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:26:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1089723584',display_name='tempest-VolumesGetTest-Volume-1128717436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a2de18-073c-464d-8d14-478d4a5b850a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b4918891974a0ca191d943f87c3a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:07Z,use_quota=True,user_id='b76ae204362a4388b2f3acaf63a4f842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189eeac0-2e80-4525-949b-c80a1619fa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189eeac0-2e80-4525-949b-c80a1619fa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae51b56-ac23-44cf-aa11-16e57016cbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bae51b56-ac23-44cf-aa11-16e57016cbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67a2de18-073c-464d-8d14-478d4a5b850a', 'volume_name': 'volume-67a2de18-073c-464d-8d14-478d4a5b850a', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632e9978-dd05-4d0f-adb0-330f01feb042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632e9978-dd05-4d0f-adb0-330f01feb042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8a772b-f218-4807-88e6-8b660311eaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:07 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Volume 67a2de18-073c-464d-8d14-478d4a5b850a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67a2de18-073c-464d-8d14-478d4a5b850a', 'volume_size': 1}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:26:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1089723584',display_name='tempest-VolumesGetTest-Volume-1128717436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67a2de18-073c-464d-8d14-478d4a5b850a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1b4918891974a0ca191d943f87c3a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:07Z,use_quota=True,user_id='b76ae204362a4388b2f3acaf63a4f842',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Creating volume 67a2de18-073c-464d-8d14-478d4a5b850a {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:26:07 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-67a2de18-073c-464d-8d14-478d4a5b850a 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:07 devstack sudo[103196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-67a2de18-073c-464d-8d14-478d4a5b850a 1073741824
Aug 12 16:26:07 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Flow 'volume_create_manager' (275ce834-1068-447e-aa58-f9009c94f9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5282a903-8fcb-43e3-8e5d-292cc2631562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5282a903-8fcb-43e3-8e5d-292cc2631562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1510421964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c93dd05c-fce3-4e03-b880-895e6c3191b6,host='devstack@QuobyteHD#QuobyteHD',id=a072dc27-60aa-4fea-95aa-597644a48598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75c9057fa5a4409a5333acc1ccaa47b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:08Z,use_quota=True,user_id='09084b2e29b845118c87e5eb4d3599a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6656e2e6-dc9f-454a-bf37-e19c66114bfc),volume_type_id=6656e2e6-dc9f-454a-bf37-e19c66114bfc)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b071ab-fb62-40af-979b-55388f2103d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10b071ab-fb62-40af-979b-55388f2103d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c89a1d7-6b7b-47c4-a2c4-4321bde4d358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c89a1d7-6b7b-47c4-a2c4-4321bde4d358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a072dc27-60aa-4fea-95aa-597644a48598', 'volume_name': 'volume-a072dc27-60aa-4fea-95aa-597644a48598', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8601c6-8c12-4cc9-b1de-2c25b9682894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8601c6-8c12-4cc9-b1de-2c25b9682894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af78d2b0-57d8-4100-b81e-dd4e39690617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:07 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Volume a072dc27-60aa-4fea-95aa-597644a48598: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a072dc27-60aa-4fea-95aa-597644a48598', 'volume_size': 1}
Aug 12 16:26:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:26:08 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Flow 'volume_create_manager' (5b6cef35-e920-4ec1-892f-a8885cec1936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6c2cf7-ea35-49e5-8a90-aae9cec590c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-67a2de18-073c-464d-8d14-478d4a5b850a 1073741824" returned: 0 in 0.579s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d6c2cf7-ea35-49e5-8a90-aae9cec590c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-522736152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3812693e-ada5-423c-8817-6cfe8d1ef70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea567aa363ad4885a0aaa0c38f9c9fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:08Z,use_quota=True,user_id='602e329e842a453fb753e66788b52fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf02c062-94cb-430c-a908-c07ece481933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf02c062-94cb-430c-a908-c07ece481933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7df50fe-5751-469c-897d-8cd4d039b2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7df50fe-5751-469c-897d-8cd4d039b2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3812693e-ada5-423c-8817-6cfe8d1ef70f', 'volume_name': 'volume-3812693e-ada5-423c-8817-6cfe8d1ef70f', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc90009b-63c1-40d5-89bf-b8945c4299b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc90009b-63c1-40d5-89bf-b8945c4299b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1672194-08b8-4438-9e5a-4ff1118c48c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:08 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Volume 3812693e-ada5-423c-8817-6cfe8d1ef70f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3812693e-ada5-423c-8817-6cfe8d1ef70f', 'volume_size': 1}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-67a2de18-073c-464d-8d14-478d4a5b850a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:08 devstack sudo[103202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-67a2de18-073c-464d-8d14-478d4a5b850a
Aug 12 16:26:08 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:08 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-67a2de18-073c-464d-8d14-478d4a5b850a" returned: 0 in 0.266s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.675s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c93dd05c-fce3-4e03-b880-895e6c3191b6,created_at=2026-08-12T14:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1510421964',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c93dd05c-fce3-4e03-b880-895e6c3191b6,host='devstack@QuobyteHD#QuobyteHD',id=a072dc27-60aa-4fea-95aa-597644a48598,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75c9057fa5a4409a5333acc1ccaa47b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:08Z,use_quota=True,user_id='09084b2e29b845118c87e5eb4d3599a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6656e2e6-dc9f-454a-bf37-e19c66114bfc),volume_type_id=6656e2e6-dc9f-454a-bf37-e19c66114bfc)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Creating volume a072dc27-60aa-4fea-95aa-597644a48598 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:26:08 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8a772b-f218-4807-88e6-8b660311eaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67a2de18-073c-464d-8d14-478d4a5b850a', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b66966c-f34b-44bc-a471-144cdc755c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:08 devstack sudo[103205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598 1073741824
Aug 12 16:26:08 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:08 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Volume volume-67a2de18-073c-464d-8d14-478d4a5b850a (67a2de18-073c-464d-8d14-478d4a5b850a): created successfully
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b66966c-f34b-44bc-a471-144cdc755c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Flow 'volume_create_manager' (98a61cde-9a86-4976-bc0d-fdb95a45e0d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:08 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-42af296f-3150-4f77-ab26-1961b95a2f54 tempest-VolumesGetTest-1084562085 None] Created volume successfully.
Aug 12 16:26:08 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598 1073741824" returned: 0 in 0.496s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:09 devstack sudo[103214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598
Aug 12 16:26:09 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:09 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598" returned: 0 in 0.283s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.132s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-522736152',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3812693e-ada5-423c-8817-6cfe8d1ef70f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea567aa363ad4885a0aaa0c38f9c9fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:08Z,use_quota=True,user_id='602e329e842a453fb753e66788b52fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Creating volume 3812693e-ada5-423c-8817-6cfe8d1ef70f {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:26:09 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3812693e-ada5-423c-8817-6cfe8d1ef70f 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af78d2b0-57d8-4100-b81e-dd4e39690617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a072dc27-60aa-4fea-95aa-597644a48598', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:09 devstack sudo[103217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3812693e-ada5-423c-8817-6cfe8d1ef70f 1073741824
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ba95cc-fe60-4611-8e3b-6a372c22cfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:09 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:09 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Volume volume-a072dc27-60aa-4fea-95aa-597644a48598 (a072dc27-60aa-4fea-95aa-597644a48598): created successfully
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ba95cc-fe60-4611-8e3b-6a372c22cfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Flow 'volume_create_manager' (275ce834-1068-447e-aa58-f9009c94f9f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:09 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-263d7af3-8ab7-4217-8d41-831a2ebab4fe tempest-GroupSnapshotsTest-2118143769 None] Created volume successfully.
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] Acquiring lock "cinder-67a2de18-073c-464d-8d14-478d4a5b850a-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] Lock "cinder-67a2de18-073c-464d-8d14-478d4a5b850a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] Acquiring lock "cinder-quobyte-67a2de18-073c-464d-8d14-478d4a5b850a" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] Lock "cinder-quobyte-67a2de18-073c-464d-8d14-478d4a5b850a" acquired by "delete_volume" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df3439a-86b2-4bd2-9e33-46750fed10cc]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-67a2de18-073c-464d-8d14-478d4a5b850a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:09 devstack sudo[103224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-67a2de18-073c-464d-8d14-478d4a5b850a
Aug 12 16:26:09 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:09 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3812693e-ada5-423c-8817-6cfe8d1ef70f 1073741824" returned: 0 in 0.592s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3812693e-ada5-423c-8817-6cfe8d1ef70f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:09 devstack sudo[103227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3812693e-ada5-423c-8817-6cfe8d1ef70f
Aug 12 16:26:09 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:10 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-67a2de18-073c-464d-8d14-478d4a5b850a" returned: 0 in 0.605s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-67a2de18-073c-464d-8d14-478d4a5b850a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:10 devstack sudo[103235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-67a2de18-073c-464d-8d14-478d4a5b850a
Aug 12 16:26:10 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:10 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3812693e-ada5-423c-8817-6cfe8d1ef70f" returned: 0 in 0.427s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1672194-08b8-4438-9e5a-4ff1118c48c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3812693e-ada5-423c-8817-6cfe8d1ef70f', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb96998-f900-4eb5-9f53-6a8ed0a7c430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:10 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Volume volume-3812693e-ada5-423c-8817-6cfe8d1ef70f (3812693e-ada5-423c-8817-6cfe8d1ef70f): created successfully
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb96998-f900-4eb5-9f53-6a8ed0a7c430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Flow 'volume_create_manager' (5b6cef35-e920-4ec1-892f-a8885cec1936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:10 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-56dba31f-0806-4ecb-a015-b38b543623a7 tempest-VolumesActionsTest-622136765 None] Created volume successfully.
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Flow 'volume_create_manager' (c21d1282-c01a-4d21-ac8e-5f140d77374e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58649bfa-6221-4ae7-a8a1-280d0da9cf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58649bfa-6221-4ae7-a8a1-280d0da9cf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1478077135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c93dd05c-fce3-4e03-b880-895e6c3191b6,host='devstack@QuobyteHD#QuobyteHD',id=5f56d05e-94ad-4cdc-9bc5-79dc400e73a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75c9057fa5a4409a5333acc1ccaa47b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:11Z,use_quota=True,user_id='09084b2e29b845118c87e5eb4d3599a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6656e2e6-dc9f-454a-bf37-e19c66114bfc),volume_type_id=6656e2e6-dc9f-454a-bf37-e19c66114bfc)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33460e52-2f8f-4777-a788-3249d4f3f45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33460e52-2f8f-4777-a788-3249d4f3f45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7ecf44-0651-4a38-95f3-82c09f849bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd7ecf44-0651-4a38-95f3-82c09f849bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f56d05e-94ad-4cdc-9bc5-79dc400e73a8', 'volume_name': 'volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e6015a-0384-42b5-a905-e359cfddc610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e6015a-0384-42b5-a905-e359cfddc610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b39c6d-8f1e-45ee-af83-7f9ef95a4c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:10 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Volume 5f56d05e-94ad-4cdc-9bc5-79dc400e73a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8', 'volume_size': 1}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=c93dd05c-fce3-4e03-b880-895e6c3191b6,created_at=2026-08-12T14:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1478077135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=c93dd05c-fce3-4e03-b880-895e6c3191b6,host='devstack@QuobyteHD#QuobyteHD',id=5f56d05e-94ad-4cdc-9bc5-79dc400e73a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75c9057fa5a4409a5333acc1ccaa47b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:11Z,use_quota=True,user_id='09084b2e29b845118c87e5eb4d3599a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6656e2e6-dc9f-454a-bf37-e19c66114bfc),volume_type_id=6656e2e6-dc9f-454a-bf37-e19c66114bfc)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Creating volume 5f56d05e-94ad-4cdc-9bc5-79dc400e73a8 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:26:10 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:10 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:10 devstack sudo[103241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8 1073741824
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-67a2de18-073c-464d-8d14-478d4a5b850a" returned: 0 in 0.489s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:10 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] Lock "cinder-quobyte-67a2de18-073c-464d-8d14-478d4a5b850a" released by "delete_volume" :: held 1.156s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] Created reservations ['547e7f46-241f-40ac-86b6-bfc546a23bae', '55739834-675b-4e14-b7b4-5b8afafc4603', '8f99f78d-d2f3-4490-b10d-f3f98eab55cc', '61cd820f-1531-4b5b-8b76-a7433dc56bbc'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:11 devstack sudo[103249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:26:11 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:11 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8 1073741824" returned: 0 in 0.714s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:11 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.491s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:11 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:26:11 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] Deleted volume successfully.
Aug 12 16:26:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d2833ed3-97f0-4296-9a65-6de7ec169bd6 tempest-VolumesGetTest-1084562085 None] Lock "cinder-67a2de18-073c-464d-8d14-478d4a5b850a-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:11 devstack sudo[103263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8
Aug 12 16:26:11 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] Acquiring lock "cinder-3812693e-ada5-423c-8817-6cfe8d1ef70f-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] Lock "cinder-3812693e-ada5-423c-8817-6cfe8d1ef70f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] Acquiring lock "cinder-quobyte-3812693e-ada5-423c-8817-6cfe8d1ef70f" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] Lock "cinder-quobyte-3812693e-ada5-423c-8817-6cfe8d1ef70f" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:11 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd23c55-7f13-479f-ad92-e32dd16d76f8]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3812693e-ada5-423c-8817-6cfe8d1ef70f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:11 devstack sudo[103265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3812693e-ada5-423c-8817-6cfe8d1ef70f
Aug 12 16:26:11 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:11 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8" returned: 0 in 0.417s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:26:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b39c6d-8f1e-45ee-af83-7f9ef95a4c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146a770a-d3aa-4363-a237-ec53c4dafe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] Acquiring lock "cinder-1998d562-0e95-4f39-a548-5d79bb33b674-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:12 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Volume volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8 (5f56d05e-94ad-4cdc-9bc5-79dc400e73a8): created successfully
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (146a770a-d3aa-4363-a237-ec53c4dafe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Flow 'volume_create_manager' (c21d1282-c01a-4d21-ac8e-5f140d77374e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] Lock "cinder-1998d562-0e95-4f39-a548-5d79bb33b674-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:12 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-fc6e4cd5-659d-4ab3-b1e1-2a3aff0296f0 tempest-GroupSnapshotsTest-2118143769 None] Created volume successfully.
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] Acquiring lock "cinder-quobyte-1998d562-0e95-4f39-a548-5d79bb33b674" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] Lock "cinder-quobyte-1998d562-0e95-4f39-a548-5d79bb33b674" acquired by "delete_volume" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3f3d52-6915-498b-8317-4b46eb359dd2]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1998d562-0e95-4f39-a548-5d79bb33b674 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:12 devstack sudo[103268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1998d562-0e95-4f39-a548-5d79bb33b674
Aug 12 16:26:12 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:12 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3812693e-ada5-423c-8817-6cfe8d1ef70f" returned: 0 in 0.473s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3812693e-ada5-423c-8817-6cfe8d1ef70f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:12 devstack sudo[103273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3812693e-ada5-423c-8817-6cfe8d1ef70f
Aug 12 16:26:12 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:12 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1998d562-0e95-4f39-a548-5d79bb33b674" returned: 0 in 0.394s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1998d562-0e95-4f39-a548-5d79bb33b674 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:12 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3812693e-ada5-423c-8817-6cfe8d1ef70f" returned: 0 in 0.291s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:12 devstack sudo[103279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1998d562-0e95-4f39-a548-5d79bb33b674
Aug 12 16:26:12 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] Lock "cinder-quobyte-3812693e-ada5-423c-8817-6cfe8d1ef70f" released by "delete_volume" :: held 0.823s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] Created reservations ['7329a392-a210-4701-980c-e138eb1be6ab', 'a8cbdb20-3186-4c30-8ab9-942587d4103c', '0ba1ba1a-19c7-4ef2-888b-5ecc3db891f6', 'e13bda8c-0d8a-4d61-96b2-64b5d68dc39a'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:12 devstack sudo[103281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:26:12 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:12 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1998d562-0e95-4f39-a548-5d79bb33b674" returned: 0 in 0.323s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] Lock "cinder-quobyte-1998d562-0e95-4f39-a548-5d79bb33b674" released by "delete_volume" :: held 0.774s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:12 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] Created reservations ['9212112e-828c-4fe5-9607-15422d3e4f9c', '57a4d7ab-b884-4a39-81c1-f494e44f02d8', '90fae720-7716-4e63-b75c-a158e20e9732', 'f243268b-93cd-42af-910a-4ce666e82422'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:26:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:13 devstack sudo[103286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:26:13 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:13 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.530s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:13 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:26:13 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] Deleted volume successfully.
Aug 12 16:26:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f1225db2-19fe-49a4-a136-2506f3d945a8 tempest-VolumesActionsTest-1355229510 None] Lock "cinder-3812693e-ada5-423c-8817-6cfe8d1ef70f-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:13 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ac74b4ff-c815-4ad4-9aed-bcf4a0681c26 tempest-GroupSnapshotsTest-2118143769 None] Update group completed successfully.
Aug 12 16:26:13 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.405s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:13 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:26:13 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] Deleted volume successfully.
Aug 12 16:26:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-af718594-95fd-4373-875a-6e87dc8f9801 tempest-VolumesGetTest-1084562085 None] Lock "cinder-1998d562-0e95-4f39-a548-5d79bb33b674-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:13 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:26:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Flow 'volume_create_manager' (2cef4d13-812a-40f8-98c9-2e86457faa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1993be38-d2d4-4778-a077-662083bc29d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1993be38-d2d4-4778-a077-662083bc29d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-628736381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6dc409d-dc78-4191-827b-f7da3dd44e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea567aa363ad4885a0aaa0c38f9c9fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:14Z,use_quota=True,user_id='602e329e842a453fb753e66788b52fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a004e805-27b7-44e1-aeff-5b8969884750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a004e805-27b7-44e1-aeff-5b8969884750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ca2db7-1040-4eef-8b06-470cc572e789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95ca2db7-1040-4eef-8b06-470cc572e789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6dc409d-dc78-4191-827b-f7da3dd44e30', 'volume_name': 'volume-d6dc409d-dc78-4191-827b-f7da3dd44e30', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d612ef-12c3-4d44-bbbf-1e8ff7e17c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d612ef-12c3-4d44-bbbf-1e8ff7e17c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b5997b-b5eb-44d0-9053-e65de42d7637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:14 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Volume d6dc409d-dc78-4191-827b-f7da3dd44e30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6dc409d-dc78-4191-827b-f7da3dd44e30', 'volume_size': 1}
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-628736381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6dc409d-dc78-4191-827b-f7da3dd44e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea567aa363ad4885a0aaa0c38f9c9fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:14Z,use_quota=True,user_id='602e329e842a453fb753e66788b52fec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Creating volume d6dc409d-dc78-4191-827b-f7da3dd44e30 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:26:14 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d6dc409d-dc78-4191-827b-f7da3dd44e30 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:14 devstack sudo[103320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d6dc409d-dc78-4191-827b-f7da3dd44e30 1073741824
Aug 12 16:26:14 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:14 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-bca1c73e-914d-4ab6-a447-caf574b16887 tempest-GroupSnapshotsTest-2118143769 None] Update group completed successfully.
Aug 12 16:26:14 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d6dc409d-dc78-4191-827b-f7da3dd44e30 1073741824" returned: 0 in 0.881s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d6dc409d-dc78-4191-827b-f7da3dd44e30 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:15 devstack sudo[103363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d6dc409d-dc78-4191-827b-f7da3dd44e30
Aug 12 16:26:15 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:15 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d6dc409d-dc78-4191-827b-f7da3dd44e30" returned: 0 in 0.353s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:26:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:15 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2b5997b-b5eb-44d0-9053-e65de42d7637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6dc409d-dc78-4191-827b-f7da3dd44e30', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:15 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ecadf2-50d6-455e-86b4-964d95451d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:15 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Volume volume-d6dc409d-dc78-4191-827b-f7da3dd44e30 (d6dc409d-dc78-4191-827b-f7da3dd44e30): created successfully
Aug 12 16:26:15 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ecadf2-50d6-455e-86b4-964d95451d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:15 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Flow 'volume_create_manager' (2cef4d13-812a-40f8-98c9-2e86457faa8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:15 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-4e6e362a-c68e-42a0-b85b-6b3b47dbfbcf tempest-VolumesActionsTest-622136765 None] Created volume successfully.
Aug 12 16:26:15 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-25eb6ef3-c7d0-418e-a375-81971f82483d tempest-GroupSnapshotsTest-2118143769 None] Update group completed successfully.
Aug 12 16:26:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] Acquiring lock "cinder-d6dc409d-dc78-4191-827b-f7da3dd44e30-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] Lock "cinder-d6dc409d-dc78-4191-827b-f7da3dd44e30-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] Acquiring lock "cinder-quobyte-d6dc409d-dc78-4191-827b-f7da3dd44e30" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] Lock "cinder-quobyte-d6dc409d-dc78-4191-827b-f7da3dd44e30" acquired by "delete_volume" :: waited 0.035s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:16 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[530ff72c-eced-4056-9dab-5588a11d4a5d]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d6dc409d-dc78-4191-827b-f7da3dd44e30 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:17 devstack sudo[103385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d6dc409d-dc78-4191-827b-f7da3dd44e30
Aug 12 16:26:17 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:17 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-bf816057-38fa-4a96-8e64-f9c1f0c61357 tempest-GroupSnapshotsTest-2118143769 None] Update group completed successfully.
Aug 12 16:26:17 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d6dc409d-dc78-4191-827b-f7da3dd44e30" returned: 0 in 0.509s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d6dc409d-dc78-4191-827b-f7da3dd44e30 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:17 devstack sudo[103390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d6dc409d-dc78-4191-827b-f7da3dd44e30
Aug 12 16:26:17 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:17 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d6dc409d-dc78-4191-827b-f7da3dd44e30" returned: 0 in 0.368s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] Lock "cinder-quobyte-d6dc409d-dc78-4191-827b-f7da3dd44e30" released by "delete_volume" :: held 0.978s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:17 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] Created reservations ['e5d88e16-81f1-45fb-a4de-3a057edd7095', '2014ad8a-cd80-407c-98b9-d402f7d04f43', 'a4a0e76a-dc0f-4177-95fd-5c59e0a92dc3', 'd7463881-4099-46e6-b587-91280d7dbb27'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:26:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:18 devstack sudo[103393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:26:18 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:18 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.492s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:18 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:26:18 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] Deleted volume successfully.
Aug 12 16:26:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7d5eda24-0527-45de-a124-bf36ea9581c5 tempest-VolumesActionsTest-622136765 None] Lock "cinder-d6dc409d-dc78-4191-827b-f7da3dd44e30-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:19 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] GroupSnapshot 88cd3544-c0a5-4688-816a-742de15b9b9c: creating.
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Group snapshot 88cd3544-c0a5-4688-816a-742de15b9b9c: creating. {{(pid=94457) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Creating offline snapshot 0a07fe18-d575-4e27-bcb9-54618782681b of volume a072dc27-60aa-4fea-95aa-597644a48598 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e58bc1c-9910-41d1-bf76-60f82f53039b]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:19 devstack sudo[103432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598
Aug 12 16:26:19 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:19 devstack sudo[103433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:26:19 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:19 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598" returned: 0 in 0.508s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:19 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.388s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 28 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:26:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:26:19 devstack sudo[103442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b 1G
Aug 12 16:26:19 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:20 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b 1G" returned: 0 in 0.507s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a072dc27-60aa-4fea-95aa-597644a48598 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:20 devstack sudo[103449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a072dc27-60aa-4fea-95aa-597644a48598 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b
Aug 12 16:26:20 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:20 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a072dc27-60aa-4fea-95aa-597644a48598 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b" returned: 0 in 0.451s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:20 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b is being set with open permissions: ugo+rw: NotImplementedError
Aug 12 16:26:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:20 devstack sudo[103455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b
Aug 12 16:26:20 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:21 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b" returned: 0 in 0.424s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:21 devstack sudo[103458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.info
Aug 12 16:26:21 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:21 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.info" returned: 0 in 0.496s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:21 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 12 16:26:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:21 devstack sudo[103462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.info
Aug 12 16:26:21 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:22 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.info" returned: 0 in 0.305s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.818s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Creating offline snapshot a584c434-dcdd-4a37-b374-abf004d06a04 of volume 5f56d05e-94ad-4cdc-9bc5-79dc400e73a8 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:26:22 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[8327e0bc-b03a-4884-98ab-762e73d534fb]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:22 devstack sudo[103465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8
Aug 12 16:26:22 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:22 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8" returned: 0 in 0.532s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:22 devstack sudo[103470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04 1G
Aug 12 16:26:22 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:23 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04 1G" returned: 0 in 0.497s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:23 devstack sudo[103476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04
Aug 12 16:26:23 devstack sudo[103476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:23 devstack sudo[103476]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04" returned: 0 in 0.348s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:23 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04 is being set with open permissions: ugo+rw: NotImplementedError
Aug 12 16:26:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:23 devstack sudo[103482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04
Aug 12 16:26:23 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:23 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04" returned: 0 in 0.359s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:23 devstack sudo[103485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.info
Aug 12 16:26:23 devstack sudo[103485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:24 devstack sudo[103485]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.info" returned: 0 in 0.385s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:24 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 12 16:26:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:24 devstack sudo[103488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.info
Aug 12 16:26:24 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:24 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.info" returned: 0 in 0.350s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.615s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:24 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-90164f55-4798-4c74-883e-89ff53956b7c tempest-GroupSnapshotsTest-2118143769 None] group_snapshot 88cd3544-c0a5-4688-816a-742de15b9b9c: created successfully
Aug 12 16:26:26 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] group_snapshot 88cd3544-c0a5-4688-816a-742de15b9b9c: deleting
Aug 12 16:26:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] group_snapshot 88cd3544-c0a5-4688-816a-742de15b9b9c: deleting {{(pid=94457) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 12 16:26:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "cinder-quobyte-a072dc27-60aa-4fea-95aa-597644a48598" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-a072dc27-60aa-4fea-95aa-597644a48598" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "cinder-quobyte-0a07fe18-d575-4e27-bcb9-54618782681b" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-0a07fe18-d575-4e27-bcb9-54618782681b" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Deleting offline snapshot 0a07fe18-d575-4e27-bcb9-54618782681b of volume a072dc27-60aa-4fea-95aa-597644a48598 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:26:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] snapshot_file for this snap is: volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:26:26 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59eaf07-6066-40e2-a273-6e0fded88c9d]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:26 devstack sudo[103492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b
Aug 12 16:26:26 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:26 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b" returned: 0 in 0.562s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a072dc27-60aa-4fea-95aa-597644a48598(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:26:26 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e83c28-3091-4b5c-99fe-76e4355de9ea]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:27 devstack sudo[103497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598
Aug 12 16:26:27 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:27 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598" returned: 0 in 0.500s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:27 devstack sudo[103502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b
Aug 12 16:26:27 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:27 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b" returned: 0 in 0.460s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:27 devstack sudo[103509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b
Aug 12 16:26:27 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:28 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598.0a07fe18-d575-4e27-bcb9-54618782681b" returned: 0 in 0.431s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-0a07fe18-d575-4e27-bcb9-54618782681b" released by "_delete_snapshot" :: held 2.156s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-a072dc27-60aa-4fea-95aa-597644a48598" released by "delete_snapshot" :: held 2.210s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "cinder-quobyte-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "cinder-quobyte-a584c434-dcdd-4a37-b374-abf004d06a04" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-a584c434-dcdd-4a37-b374-abf004d06a04" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:28 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Deleting offline snapshot a584c434-dcdd-4a37-b374-abf004d06a04 of volume 5f56d05e-94ad-4cdc-9bc5-79dc400e73a8 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:26:28 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] snapshot_file for this snap is: volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:26:28 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[274a9ee8-bf35-4e59-a221-377c0d98f558]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:28 devstack sudo[103512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04
Aug 12 16:26:28 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:29 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04" returned: 0 in 0.647s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:26:29 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2042e04-c8dc-4da0-ae66-6a5a9bf44ca3]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:29 devstack sudo[103542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8
Aug 12 16:26:29 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:29 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8" returned: 0 in 0.506s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:29 devstack sudo[103549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04
Aug 12 16:26:29 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:30 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04" returned: 0 in 0.440s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:30 devstack sudo[103554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04
Aug 12 16:26:30 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:30 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8.a584c434-dcdd-4a37-b374-abf004d06a04" returned: 0 in 0.322s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-a584c434-dcdd-4a37-b374-abf004d06a04" released by "_delete_snapshot" :: held 2.063s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8" released by "delete_snapshot" :: held 2.098s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:30 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:INSERT=46,cinder:UPDATE=189,cinder:SELECT=155,cinder:DELETE=14 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:26:30 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=155,cinder:INSERT=48,cinder:UPDATE=174,cinder:DELETE=11 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:26:30 devstack cinder-volume[94457]: WARNING cinder.quota [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1533794005 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1533794005, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:26:30 devstack cinder-volume[94457]: WARNING cinder.quota [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1533794005 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1533794005, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:26:30 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Created reservations ['7b88d9bf-32a5-4493-b3e9-f6f49a6aa725', '21f7fd8d-80b0-42e6-908f-2b5e1921de66', '028e5d9e-622e-4690-9a61-9371a279f047', 'a7ac64fe-cb3d-4dab-8a38-31dc16687e48'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:26:30 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] Created reservations ['3c86d5eb-e3de-4a2f-83c4-c045d8fab239', '7be697be-615e-4d2c-9109-732861016e2e', 'ced3334a-8135-46ae-a5ff-2d90947d45b9', '1ae4867e-5b34-4f8a-8331-7e76e27cb02b'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:26:30 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-6a262cc2-c1b6-4d31-a34e-109b6749d896 tempest-GroupSnapshotsTest-2118143769 None] group_snapshot 88cd3544-c0a5-4688-816a-742de15b9b9c: deleted successfully
Aug 12 16:26:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "cinder-quobyte-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8" acquired by "delete_volume" :: waited 0.020s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:32 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b55d86b-4d07-4fe3-a1d8-cb9f2fff9ad1]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:32 devstack sudo[103563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8
Aug 12 16:26:32 devstack sudo[103563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:33 devstack sudo[103563]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8" returned: 0 in 0.443s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:33 devstack sudo[103568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8
Aug 12 16:26:33 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:33 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8" returned: 0 in 0.289s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-5f56d05e-94ad-4cdc-9bc5-79dc400e73a8" released by "delete_volume" :: held 0.834s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "cinder-quobyte-a072dc27-60aa-4fea-95aa-597644a48598" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-a072dc27-60aa-4fea-95aa-597644a48598" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:33 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b30f42c-acee-479e-921e-1658120dfe5c]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:33 devstack sudo[103571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598
Aug 12 16:26:33 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:33 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598" returned: 0 in 0.373s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:33 devstack sudo[103576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598
Aug 12 16:26:33 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:34 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a072dc27-60aa-4fea-95aa-597644a48598" returned: 0 in 0.284s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-a072dc27-60aa-4fea-95aa-597644a48598" released by "delete_volume" :: held 0.726s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:34 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Created reservations ['98fb5348-0beb-4292-a575-ceea8c3aa1d0'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:26:34 devstack cinder-volume[94457]: WARNING cinder.quota [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1533794005 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1533794005, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:26:34 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Created reservations ['45d762dd-e2df-4b6f-b1d9-39bd10ea7948', 'a3a49566-eda8-418d-89d0-7fc821bd41ee', '4ee3a43a-1f66-49c0-b6fd-b183dd355269', 'c2147a3e-0344-4074-8902-e196410a0756'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:26:34 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Created reservations ['a8036c2a-bb75-4083-b0c9-170d98633c54', '5506ebc8-8f38-401a-bdca-6484b1f14d3b', '46ad8e9f-f4eb-4cf1-af3c-f9a421687228', 'd7d13d9a-3f9b-42cb-9849-0928c19cf37f'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:26:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:34 devstack sudo[103579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:26:34 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:34 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.253s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:34 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:26:34 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-9a86667a-557c-45e5-b0e6-cd8c4081d5bb tempest-GroupSnapshotsTest-2118143769 None] Delete group completed successfully.
Aug 12 16:26:35 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-112c25f3-08a6-414b-86a9-e4a3cf1a0f6d tempest-GroupSnapshotsTest-2118143769 None] Group tempest-GroupSnapshotsTest-Group-929355505: creating
Aug 12 16:26:35 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-112c25f3-08a6-414b-86a9-e4a3cf1a0f6d tempest-GroupSnapshotsTest-2118143769 None] Group tempest-GroupSnapshotsTest-Group-929355505: created successfully
Aug 12 16:26:35 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-112c25f3-08a6-414b-86a9-e4a3cf1a0f6d tempest-GroupSnapshotsTest-2118143769 None] Create group completed successfully.
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Flow 'volume_create_manager' (b2ae43fb-9e98-48c0-8ce7-930f01b20e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59daa86a-4078-4c4b-9a00-b5388b620289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59daa86a-4078-4c4b-9a00-b5388b620289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1012929202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=604c11bb-3ead-4797-b349-de7b7645b4e6,host='devstack@QuobyteHD#QuobyteHD',id=3ac0f881-9d64-4fbb-9d9f-97877d0d0d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75c9057fa5a4409a5333acc1ccaa47b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:37Z,use_quota=True,user_id='09084b2e29b845118c87e5eb4d3599a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6199281-69da-4c2d-9da6-8d56bfc98ba3),volume_type_id=d6199281-69da-4c2d-9da6-8d56bfc98ba3)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0697de61-c9b7-4d06-a66c-fc1628e413c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0697de61-c9b7-4d06-a66c-fc1628e413c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9532c57-9035-45d1-9bf4-1d224c714c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9532c57-9035-45d1-9bf4-1d224c714c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ac0f881-9d64-4fbb-9d9f-97877d0d0d76', 'volume_name': 'volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa882548-f208-45b2-bb95-c895b87af411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa882548-f208-45b2-bb95-c895b87af411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4859edd-cb55-4325-8ef9-f746d67eb0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:37 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Volume 3ac0f881-9d64-4fbb-9d9f-97877d0d0d76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76', 'volume_size': 1}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=604c11bb-3ead-4797-b349-de7b7645b4e6,created_at=2026-08-12T14:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1012929202',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=604c11bb-3ead-4797-b349-de7b7645b4e6,host='devstack@QuobyteHD#QuobyteHD',id=3ac0f881-9d64-4fbb-9d9f-97877d0d0d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75c9057fa5a4409a5333acc1ccaa47b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:37Z,use_quota=True,user_id='09084b2e29b845118c87e5eb4d3599a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6199281-69da-4c2d-9da6-8d56bfc98ba3),volume_type_id=d6199281-69da-4c2d-9da6-8d56bfc98ba3)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Creating volume 3ac0f881-9d64-4fbb-9d9f-97877d0d0d76 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:26:37 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:26:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:37 devstack sudo[103584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76 1073741824
Aug 12 16:26:37 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:38 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76 1073741824" returned: 0 in 0.643s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:38 devstack sudo[103591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76
Aug 12 16:26:38 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:38 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76" returned: 0 in 0.289s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:26:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:38 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4859edd-cb55-4325-8ef9-f746d67eb0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:38 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9145d3fd-efe6-4676-9404-4a5828d9ca97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:38 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Volume volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76 (3ac0f881-9d64-4fbb-9d9f-97877d0d0d76): created successfully
Aug 12 16:26:38 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9145d3fd-efe6-4676-9404-4a5828d9ca97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:38 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Flow 'volume_create_manager' (b2ae43fb-9e98-48c0-8ce7-930f01b20e8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:38 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-cdbbc399-85cc-4431-9efb-69dd311b23d0 tempest-GroupSnapshotsTest-2118143769 None] Created volume successfully.
Aug 12 16:26:40 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] GroupSnapshot cd214343-54d6-4294-a5e6-03c52783f5e7: creating.
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] Group snapshot cd214343-54d6-4294-a5e6-03c52783f5e7: creating. {{(pid=94457) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] Creating offline snapshot 8f79db29-1694-4a66-b545-ccaea888cc40 of volume 3ac0f881-9d64-4fbb-9d9f-97877d0d0d76 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8190d4f-2d66-4bc8-bdb7-50d5451f2c1c]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Flow 'volume_create_manager' (aeebfd2f-014f-4320-bff8-04fcc8c09dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed8496f-f1bc-4f69-8a2b-f444c5382eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ed8496f-f1bc-4f69-8a2b-f444c5382eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1332749285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21dd8786-4461-4f1f-a87d-22c48c844aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8468ce87fb44cfbf006f7bbd4e0c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:40Z,use_quota=True,user_id='2ee817bc23744a52be661f9de34d6b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91dc47a-a5dd-4547-bc26-7dd5cb106f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a91dc47a-a5dd-4547-bc26-7dd5cb106f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c177a7-bd30-433e-b288-362f3e3d4070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c177a7-bd30-433e-b288-362f3e3d4070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21dd8786-4461-4f1f-a87d-22c48c844aee', 'volume_name': 'volume-21dd8786-4461-4f1f-a87d-22c48c844aee', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5afebf01-e3b1-48c9-bc65-4a4b58e03fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5afebf01-e3b1-48c9-bc65-4a4b58e03fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:40 devstack sudo[103597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76
Aug 12 16:26:40 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4f8f9a-ba7c-40c6-88bb-90f9f0b4f4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:40 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Volume 21dd8786-4461-4f1f-a87d-22c48c844aee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21dd8786-4461-4f1f-a87d-22c48c844aee', 'volume_size': 1}
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:40 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76" returned: 0 in 0.484s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:40 devstack sudo[103604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40 1G
Aug 12 16:26:40 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:41 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40 1G" returned: 0 in 0.579s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:41 devstack sudo[103610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40
Aug 12 16:26:41 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:41 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40" returned: 0 in 0.342s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:41 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40 is being set with open permissions: ugo+rw: NotImplementedError
Aug 12 16:26:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:41 devstack sudo[103616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40
Aug 12 16:26:41 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:42 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40" returned: 0 in 0.303s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:42 devstack sudo[103619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.info
Aug 12 16:26:42 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:42 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.info" returned: 0 in 0.332s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:42 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.info is being set with open permissions: ugo+rw: NotImplementedError
Aug 12 16:26:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:42 devstack sudo[103622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.info
Aug 12 16:26:42 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:42 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.info" returned: 0 in 0.286s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.451s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.217s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1332749285',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21dd8786-4461-4f1f-a87d-22c48c844aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8468ce87fb44cfbf006f7bbd4e0c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:40Z,use_quota=True,user_id='2ee817bc23744a52be661f9de34d6b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:26:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Creating volume 21dd8786-4461-4f1f-a87d-22c48c844aee {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:26:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:26:42 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:26:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21dd8786-4461-4f1f-a87d-22c48c844aee 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:42 devstack sudo[103625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21dd8786-4461-4f1f-a87d-22c48c844aee 1073741824
Aug 12 16:26:42 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:42 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-66a4abf9-a82e-4088-8eaf-e794a5255380 tempest-GroupSnapshotsTest-2118143769 None] group_snapshot cd214343-54d6-4294-a5e6-03c52783f5e7: created successfully
Aug 12 16:26:43 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21dd8786-4461-4f1f-a87d-22c48c844aee 1073741824" returned: 0 in 0.523s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21dd8786-4461-4f1f-a87d-22c48c844aee {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:43 devstack sudo[103631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21dd8786-4461-4f1f-a87d-22c48c844aee
Aug 12 16:26:43 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:43 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21dd8786-4461-4f1f-a87d-22c48c844aee" returned: 0 in 0.338s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:43 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:26:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d4f8f9a-ba7c-40c6-88bb-90f9f0b4f4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21dd8786-4461-4f1f-a87d-22c48c844aee', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba4216e-b21a-4851-9267-b5de2329388a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:43 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Volume volume-21dd8786-4461-4f1f-a87d-22c48c844aee (21dd8786-4461-4f1f-a87d-22c48c844aee): created successfully
Aug 12 16:26:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba4216e-b21a-4851-9267-b5de2329388a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Flow 'volume_create_manager' (aeebfd2f-014f-4320-bff8-04fcc8c09dcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:43 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a0246c4b-7fab-409d-807e-e7f100cb6f48 tempest-AttachVolumeTestJSON-2133361617 None] Created volume successfully.
Aug 12 16:26:43 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] group_snapshot cd214343-54d6-4294-a5e6-03c52783f5e7: deleting
Aug 12 16:26:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] group_snapshot cd214343-54d6-4294-a5e6-03c52783f5e7: deleting {{(pid=94457) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Aug 12 16:26:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "cinder-quobyte-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "cinder-quobyte-8f79db29-1694-4a66-b545-ccaea888cc40" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-8f79db29-1694-4a66-b545-ccaea888cc40" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] Deleting offline snapshot 8f79db29-1694-4a66-b545-ccaea888cc40 of volume 3ac0f881-9d64-4fbb-9d9f-97877d0d0d76 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:26:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] snapshot_file for this snap is: volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:26:44 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f51b8d1-b5f0-4a8b-b950-b7638cf7c627]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:44 devstack sudo[103634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40
Aug 12 16:26:44 devstack sudo[103634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:44 devstack sudo[103634]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40" returned: 0 in 0.482s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:26:44 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d1e75f-d3ac-411b-ad7c-415c869fc405]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:44 devstack sudo[103639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76
Aug 12 16:26:44 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:45 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76" returned: 0 in 0.513s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:45 devstack sudo[103649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40
Aug 12 16:26:45 devstack sudo[103649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:45 devstack sudo[103649]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40" returned: 0 in 0.485s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:45 devstack sudo[103656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40
Aug 12 16:26:45 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-270138b6-6d20-46dd-9ba1-bffea8fa3984 req-713d46e2-de9a-42b6-8161-fbfc47a67265 tempest-AttachVolumeTestJSON-2133361617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-270138b6-6d20-46dd-9ba1-bffea8fa3984 req-713d46e2-de9a-42b6-8161-fbfc47a67265 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-270138b6-6d20-46dd-9ba1-bffea8fa3984 req-713d46e2-de9a-42b6-8161-fbfc47a67265 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:46 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76.8f79db29-1694-4a66-b545-ccaea888cc40" returned: 0 in 0.360s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-8f79db29-1694-4a66-b545-ccaea888cc40" released by "_delete_snapshot" :: held 2.024s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-270138b6-6d20-46dd-9ba1-bffea8fa3984 req-713d46e2-de9a-42b6-8161-fbfc47a67265 tempest-AttachVolumeTestJSON-2133361617 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-21dd8786-4461-4f1f-a87d-22c48c844aee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aa61b7e0-da21-4e82-b50d-e54f94e80d4b', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:26:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76" released by "delete_snapshot" :: held 2.062s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:46 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-270138b6-6d20-46dd-9ba1-bffea8fa3984 req-713d46e2-de9a-42b6-8161-fbfc47a67265 tempest-AttachVolumeTestJSON-2133361617 None] attachment_update completed successfully.
Aug 12 16:26:46 devstack cinder-volume[94457]: WARNING cinder.quota [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1991955163 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1991955163, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:26:46 devstack cinder-volume[94457]: WARNING cinder.quota [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1991955163 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1991955163, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:26:46 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] Created reservations ['8d764e66-162d-4e33-9798-aefdaa362f4c', '41023b94-ced4-4d81-8e85-88dafcb6f13e', '75ac944c-bb70-4a65-8182-bc6b8f37b63d', 'ae720eb1-b18f-4e90-8292-eddb1a615fc5'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:26:46 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-93274640-0161-44db-bc66-1c3f3012239b tempest-GroupSnapshotsTest-2118143769 None] group_snapshot cd214343-54d6-4294-a5e6-03c52783f5e7: deleted successfully
Aug 12 16:26:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d3a75877-dadd-4f23-8d47-3ec9a2755256 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "cinder-quobyte-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d3a75877-dadd-4f23-8d47-3ec9a2755256 tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76" acquired by "delete_volume" :: waited 0.033s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:46 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4459b4-c137-4abd-a521-bc43520fdd0e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d3a75877-dadd-4f23-8d47-3ec9a2755256 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:47 devstack sudo[104052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76
Aug 12 16:26:47 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Flow 'volume_create_manager' (57e631c7-149a-477d-90b9-5033a0160e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff6b6e0-1680-4ccb-b186-97e7c4a73c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff6b6e0-1680-4ccb-b186-97e7c4a73c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1743301938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db628fb5-2119-4c09-824a-1ea195f7fe0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b3f436dc4e440384cb3c0df68377db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:47Z,use_quota=True,user_id='b66a733e192341b18ab5896353913997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f391081f-73ba-4895-a1d7-d7ef29e9ebb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f391081f-73ba-4895-a1d7-d7ef29e9ebb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba6c82e-d87e-4233-abca-0172be97a4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba6c82e-d87e-4233-abca-0172be97a4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db628fb5-2119-4c09-824a-1ea195f7fe0e', 'volume_name': 'volume-db628fb5-2119-4c09-824a-1ea195f7fe0e', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d5fbcf-20d4-4f2a-acd7-d27a4fff94e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03d5fbcf-20d4-4f2a-acd7-d27a4fff94e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7878ab78-912f-4d08-b3c9-79a77fb68983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:47 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Volume db628fb5-2119-4c09-824a-1ea195f7fe0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db628fb5-2119-4c09-824a-1ea195f7fe0e', 'volume_size': 1}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:26:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1743301938',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db628fb5-2119-4c09-824a-1ea195f7fe0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4b3f436dc4e440384cb3c0df68377db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:47Z,use_quota=True,user_id='b66a733e192341b18ab5896353913997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Creating volume db628fb5-2119-4c09-824a-1ea195f7fe0e {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:26:47 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:47 devstack sudo[104056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e 1073741824
Aug 12 16:26:47 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:47 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d3a75877-dadd-4f23-8d47-3ec9a2755256 tempest-GroupSnapshotsTest-2118143769 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76" returned: 0 in 0.533s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d3a75877-dadd-4f23-8d47-3ec9a2755256 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:47 devstack sudo[104059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76
Aug 12 16:26:47 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:47 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d3a75877-dadd-4f23-8d47-3ec9a2755256 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76" returned: 0 in 0.272s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d3a75877-dadd-4f23-8d47-3ec9a2755256 tempest-GroupSnapshotsTest-2118143769 None] Lock "cinder-quobyte-3ac0f881-9d64-4fbb-9d9f-97877d0d0d76" released by "delete_volume" :: held 0.936s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-d3a75877-dadd-4f23-8d47-3ec9a2755256 tempest-GroupSnapshotsTest-2118143769 None] Created reservations ['475fca22-7fff-4854-946d-3cbf850ab572'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:26:47 devstack cinder-volume[94457]: WARNING cinder.quota [None req-d3a75877-dadd-4f23-8d47-3ec9a2755256 tempest-GroupSnapshotsTest-2118143769 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1991955163 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1991955163, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-d3a75877-dadd-4f23-8d47-3ec9a2755256 tempest-GroupSnapshotsTest-2118143769 None] Created reservations ['cc2fed2f-562c-481a-98de-1f3bbaf1a054', '10667dba-0a66-4c8b-9055-14c0e63da8dc', '3fec868f-b353-42be-af2a-ee460085e628', 'ce43ff29-d973-40e1-a1a8-e36c93d4ea6b'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:26:47 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e 1073741824" returned: 0 in 0.566s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:48 devstack sudo[104066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e
Aug 12 16:26:48 devstack sudo[104066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d3a75877-dadd-4f23-8d47-3ec9a2755256 tempest-GroupSnapshotsTest-2118143769 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d3a75877-dadd-4f23-8d47-3ec9a2755256 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d3a75877-dadd-4f23-8d47-3ec9a2755256 tempest-GroupSnapshotsTest-2118143769 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d3a75877-dadd-4f23-8d47-3ec9a2755256 tempest-GroupSnapshotsTest-2118143769 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d3a75877-dadd-4f23-8d47-3ec9a2755256 tempest-GroupSnapshotsTest-2118143769 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d3a75877-dadd-4f23-8d47-3ec9a2755256 tempest-GroupSnapshotsTest-2118143769 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:48 devstack sudo[104068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:26:48 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:48 devstack sudo[104066]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e" returned: 0 in 0.332s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7878ab78-912f-4d08-b3c9-79a77fb68983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db628fb5-2119-4c09-824a-1ea195f7fe0e', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1339ca2-2ee4-488e-9801-9d54f41c967d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:48 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Volume volume-db628fb5-2119-4c09-824a-1ea195f7fe0e (db628fb5-2119-4c09-824a-1ea195f7fe0e): created successfully
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1339ca2-2ee4-488e-9801-9d54f41c967d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Flow 'volume_create_manager' (57e631c7-149a-477d-90b9-5033a0160e34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:48 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d3a75877-dadd-4f23-8d47-3ec9a2755256 tempest-GroupSnapshotsTest-2118143769 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.424s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-d3a75877-dadd-4f23-8d47-3ec9a2755256 tempest-GroupSnapshotsTest-2118143769 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:26:48 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-9c7ad442-6551-4ce0-ab52-aa8836bedd01 tempest-SnapshotMetadataTestJSON-1220739535 None] Created volume successfully.
Aug 12 16:26:48 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-d3a75877-dadd-4f23-8d47-3ec9a2755256 tempest-GroupSnapshotsTest-2118143769 None] Delete group completed successfully.
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Flow 'volume_create_manager' (e54fb443-510f-4289-be7f-8de9b6177f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ac5fd2-8965-40de-9dab-c672505fb2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89ac5fd2-8965-40de-9dab-c672505fb2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1253194325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51c4b73-324d-4e0a-89c3-1a02d07dd7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5037e6d7ef8e4c79a82abe5a33694606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:48Z,use_quota=True,user_id='731938481e5546159b81661136e59731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5372447-5e3e-49e1-abc6-436d235dc883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5372447-5e3e-49e1-abc6-436d235dc883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f91f8f-9153-40a5-9d29-f6b3c8504f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f91f8f-9153-40a5-9d29-f6b3c8504f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b51c4b73-324d-4e0a-89c3-1a02d07dd7bb', 'volume_name': 'volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e3e68e-4f7f-4c62-bd72-40641794060d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e3e68e-4f7f-4c62-bd72-40641794060d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267cc6df-f7d2-42e8-954a-27b237efe1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:48 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Volume b51c4b73-324d-4e0a-89c3-1a02d07dd7bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb', 'volume_size': 1}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1253194325',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51c4b73-324d-4e0a-89c3-1a02d07dd7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5037e6d7ef8e4c79a82abe5a33694606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:48Z,use_quota=True,user_id='731938481e5546159b81661136e59731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Creating volume b51c4b73-324d-4e0a-89c3-1a02d07dd7bb {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:26:48 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:26:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:48 devstack sudo[104072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb 1073741824
Aug 12 16:26:48 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Flow 'volume_create_manager' (0a55a396-8ea9-43f8-ba49-8acfed109b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d59f67-5ebd-4d3f-9ff5-eb11860c0441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6d59f67-5ebd-4d3f-9ff5-eb11860c0441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1292544529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74eb022-e061-44aa-8753-009541fc7d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8468ce87fb44cfbf006f7bbd4e0c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:49Z,use_quota=True,user_id='2ee817bc23744a52be661f9de34d6b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984bb7e8-1a0e-42cc-a303-91c8a4d27bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (984bb7e8-1a0e-42cc-a303-91c8a4d27bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007b2640-7a68-442c-9fc5-9c76eb26aa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (007b2640-7a68-442c-9fc5-9c76eb26aa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a74eb022-e061-44aa-8753-009541fc7d72', 'volume_name': 'volume-a74eb022-e061-44aa-8753-009541fc7d72', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c711cf-a48f-4bd3-a0bd-b9e5794352c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c711cf-a48f-4bd3-a0bd-b9e5794352c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5a7e8e-02f7-43a1-a400-317903665a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:49 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Volume a74eb022-e061-44aa-8753-009541fc7d72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a74eb022-e061-44aa-8753-009541fc7d72', 'volume_size': 1}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:49 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb 1073741824" returned: 0 in 0.620s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:49 devstack sudo[104078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb
Aug 12 16:26:49 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1326722b-f0b6-4d30-9230-f5ceb7f716e9 tempest-SnapshotMetadataTestJSON-1220739535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:49 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb" returned: 0 in 0.296s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.482s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1292544529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74eb022-e061-44aa-8753-009541fc7d72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec8468ce87fb44cfbf006f7bbd4e0c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:26:49Z,use_quota=True,user_id='2ee817bc23744a52be661f9de34d6b2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Creating volume a74eb022-e061-44aa-8753-009541fc7d72 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:26:49 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a74eb022-e061-44aa-8753-009541fc7d72 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:49 devstack sudo[104082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a74eb022-e061-44aa-8753-009541fc7d72 1073741824
Aug 12 16:26:49 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (267cc6df-f7d2-42e8-954a-27b237efe1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2332f4f0-9749-4fcb-91fc-798137db44bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:49 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Volume volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb (b51c4b73-324d-4e0a-89c3-1a02d07dd7bb): created successfully
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2332f4f0-9749-4fcb-91fc-798137db44bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Flow 'volume_create_manager' (e54fb443-510f-4289-be7f-8de9b6177f75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:49 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-fc59cba2-a223-4f13-ba03-d6d0d8b85561 tempest-TestStampPattern-411757869 None] Created volume successfully.
Aug 12 16:26:50 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a74eb022-e061-44aa-8753-009541fc7d72 1073741824" returned: 0 in 0.578s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a74eb022-e061-44aa-8753-009541fc7d72 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:50 devstack sudo[104091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a74eb022-e061-44aa-8753-009541fc7d72
Aug 12 16:26:50 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:50 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a74eb022-e061-44aa-8753-009541fc7d72" returned: 0 in 0.354s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:26:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1326722b-f0b6-4d30-9230-f5ceb7f716e9 tempest-SnapshotMetadataTestJSON-1220739535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.154s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d5a7e8e-02f7-43a1-a400-317903665a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a74eb022-e061-44aa-8753-009541fc7d72', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b337b859-8909-41d1-90c7-1a5871bfa1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:26:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-1326722b-f0b6-4d30-9230-f5ceb7f716e9 tempest-SnapshotMetadataTestJSON-1220739535 None] Creating offline snapshot 833524af-8f4b-4844-b3a1-0bd99625f15d of volume db628fb5-2119-4c09-824a-1ea195f7fe0e {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:26:50 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Volume volume-a74eb022-e061-44aa-8753-009541fc7d72 (a74eb022-e061-44aa-8753-009541fc7d72): created successfully
Aug 12 16:26:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b337b859-8909-41d1-90c7-1a5871bfa1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:26:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Flow 'volume_create_manager' (0a55a396-8ea9-43f8-ba49-8acfed109b92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:26:50 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9222401-9e1b-4508-b116-56eacce4b9ae]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1326722b-f0b6-4d30-9230-f5ceb7f716e9 tempest-SnapshotMetadataTestJSON-1220739535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:50 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-fe9363ce-8a9c-4941-8465-0afcbf6bd550 tempest-AttachVolumeTestJSON-2133361617 None] Created volume successfully.
Aug 12 16:26:50 devstack sudo[104095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e
Aug 12 16:26:50 devstack sudo[104095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:51 devstack sudo[104095]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1326722b-f0b6-4d30-9230-f5ceb7f716e9 tempest-SnapshotMetadataTestJSON-1220739535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e" returned: 0 in 0.651s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1326722b-f0b6-4d30-9230-f5ceb7f716e9 tempest-SnapshotMetadataTestJSON-1220739535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:51 devstack sudo[104100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d 1G
Aug 12 16:26:51 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:52 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1326722b-f0b6-4d30-9230-f5ceb7f716e9 tempest-SnapshotMetadataTestJSON-1220739535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d 1G" returned: 0 in 0.719s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1326722b-f0b6-4d30-9230-f5ceb7f716e9 tempest-SnapshotMetadataTestJSON-1220739535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db628fb5-2119-4c09-824a-1ea195f7fe0e -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:52 devstack sudo[104119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db628fb5-2119-4c09-824a-1ea195f7fe0e -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d
Aug 12 16:26:52 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-28b4f032-3742-471e-b563-67a6fafb80d1 req-8853bd78-5e3f-448a-a411-97340a7f59cf tempest-AttachVolumeTestJSON-2133361617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:26:52 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1326722b-f0b6-4d30-9230-f5ceb7f716e9 tempest-SnapshotMetadataTestJSON-1220739535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db628fb5-2119-4c09-824a-1ea195f7fe0e -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d" returned: 0 in 0.441s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:52 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-1326722b-f0b6-4d30-9230-f5ceb7f716e9 tempest-SnapshotMetadataTestJSON-1220739535 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d is being set with open permissions: ugo+rw
Aug 12 16:26:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1326722b-f0b6-4d30-9230-f5ceb7f716e9 tempest-SnapshotMetadataTestJSON-1220739535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:52 devstack sudo[104140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d
Aug 12 16:26:52 devstack sudo[104140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:53 devstack sudo[104140]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1326722b-f0b6-4d30-9230-f5ceb7f716e9 tempest-SnapshotMetadataTestJSON-1220739535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d" returned: 0 in 0.430s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1326722b-f0b6-4d30-9230-f5ceb7f716e9 tempest-SnapshotMetadataTestJSON-1220739535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:53 devstack sudo[104148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.info
Aug 12 16:26:53 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:53 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1326722b-f0b6-4d30-9230-f5ceb7f716e9 tempest-SnapshotMetadataTestJSON-1220739535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.info" returned: 0 in 0.376s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:53 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-1326722b-f0b6-4d30-9230-f5ceb7f716e9 tempest-SnapshotMetadataTestJSON-1220739535 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.info is being set with open permissions: ugo+rw
Aug 12 16:26:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1326722b-f0b6-4d30-9230-f5ceb7f716e9 tempest-SnapshotMetadataTestJSON-1220739535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:53 devstack sudo[104155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.info
Aug 12 16:26:53 devstack sudo[104155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:53 devstack sudo[104155]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1326722b-f0b6-4d30-9230-f5ceb7f716e9 tempest-SnapshotMetadataTestJSON-1220739535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.info" returned: 0 in 0.331s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1326722b-f0b6-4d30-9230-f5ceb7f716e9 tempest-SnapshotMetadataTestJSON-1220739535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.084s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-28b4f032-3742-471e-b563-67a6fafb80d1 req-8853bd78-5e3f-448a-a411-97340a7f59cf tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.270s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:26:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-28b4f032-3742-471e-b563-67a6fafb80d1 req-8853bd78-5e3f-448a-a411-97340a7f59cf tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:26:53 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-1326722b-f0b6-4d30-9230-f5ceb7f716e9 tempest-SnapshotMetadataTestJSON-1220739535 None] Create snapshot completed successfully
Aug 12 16:26:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-28b4f032-3742-471e-b563-67a6fafb80d1 req-8853bd78-5e3f-448a-a411-97340a7f59cf tempest-AttachVolumeTestJSON-2133361617 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-a74eb022-e061-44aa-8753-009541fc7d72', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2d91f38-e894-4a57-bf7c-61ea70a52c03', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:26:53 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-28b4f032-3742-471e-b563-67a6fafb80d1 req-8853bd78-5e3f-448a-a411-97340a7f59cf tempest-AttachVolumeTestJSON-2133361617 None] attachment_update completed successfully.
Aug 12 16:26:56 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] Acquiring lock "cinder-833524af-8f4b-4844-b3a1-0bd99625f15d-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:56 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] Lock "cinder-833524af-8f4b-4844-b3a1-0bd99625f15d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:56 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] Acquiring lock "cinder-quobyte-db628fb5-2119-4c09-824a-1ea195f7fe0e" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:56 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] Lock "cinder-quobyte-db628fb5-2119-4c09-824a-1ea195f7fe0e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:56 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] Acquiring lock "cinder-quobyte-833524af-8f4b-4844-b3a1-0bd99625f15d" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:56 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] Lock "cinder-quobyte-833524af-8f4b-4844-b3a1-0bd99625f15d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] Deleting offline snapshot 833524af-8f4b-4844-b3a1-0bd99625f15d of volume db628fb5-2119-4c09-824a-1ea195f7fe0e {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:26:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] snapshot_file for this snap is: volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:26:56 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd89826-d99e-4909-9bbf-9b3e58014d5d]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:56 devstack sudo[104238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d
Aug 12 16:26:56 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:57 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d" returned: 0 in 0.478s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db628fb5-2119-4c09-824a-1ea195f7fe0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:26:57 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ecddf8-a72a-4694-a33e-bc781953ad6c]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:26:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:57 devstack sudo[104257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e
Aug 12 16:26:57 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:57 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-c7c1498a-da7e-450f-bfa6-991d785547b7 req-b4bcd15e-9447-4dab-b5ad-e81b9812d900 tempest-AttachVolumeTestJSON-2133361617 None] Terminate volume connection completed successfully.
Aug 12 16:26:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-c7c1498a-da7e-450f-bfa6-991d785547b7 req-b4bcd15e-9447-4dab-b5ad-e81b9812d900 tempest-AttachVolumeTestJSON-2133361617 None] Deleting attachment aa61b7e0-da21-4e82-b50d-e54f94e80d4b. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:26:57 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e" returned: 0 in 0.493s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:57 devstack sudo[104266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d
Aug 12 16:26:57 devstack sudo[104266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:58 devstack sudo[104266]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d" returned: 0 in 0.678s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:26:58 devstack sudo[104274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d
Aug 12 16:26:58 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:26:58 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root
Aug 12 16:26:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e.833524af-8f4b-4844-b3a1-0bd99625f15d" returned: 0 in 0.365s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:26:58 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] Lock "cinder-quobyte-833524af-8f4b-4844-b3a1-0bd99625f15d" released by "_delete_snapshot" :: held 2.184s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:58 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] Lock "cinder-quobyte-db628fb5-2119-4c09-824a-1ea195f7fe0e" released by "delete_snapshot" :: held 2.215s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:58 devstack cinder-volume[94457]: WARNING cinder.quota [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:26:58 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] Created reservations ['575d18cb-3ca5-4284-98ac-88c596d0e447', 'a3110f80-1915-44a8-bdad-379586b57828', '09b46368-a16b-4693-9181-44fd87c6746a', '4a04c23f-2b17-43d4-bd50-aa58c1961a41'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:26:58 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] Delete snapshot completed successfully.
Aug 12 16:26:58 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ffdf3376-e121-495f-b728-22d7b8b9bb94 tempest-SnapshotMetadataTestJSON-1220739535 None] Lock "cinder-833524af-8f4b-4844-b3a1-0bd99625f15d-delete_snapshot" released by "delete_snapshot" :: held 2.462s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:26:59 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-0d8f06a0-a159-4c30-a47c-e31c3d7bf916 req-1d86bd90-8e4e-46a7-90b2-95d2a7fe4d57 tempest-AttachVolumeTestJSON-2133361617 None] Terminate volume connection completed successfully.
Aug 12 16:26:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-0d8f06a0-a159-4c30-a47c-e31c3d7bf916 req-1d86bd90-8e4e-46a7-90b2-95d2a7fe4d57 tempest-AttachVolumeTestJSON-2133361617 None] Deleting attachment b2d91f38-e894-4a57-bf7c-61ea70a52c03. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:26:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] Acquiring lock "cinder-db628fb5-2119-4c09-824a-1ea195f7fe0e-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:26:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] Lock "cinder-db628fb5-2119-4c09-824a-1ea195f7fe0e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:26:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] Acquiring lock "cinder-quobyte-db628fb5-2119-4c09-824a-1ea195f7fe0e" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:00 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] Lock "cinder-quobyte-db628fb5-2119-4c09-824a-1ea195f7fe0e" acquired by "delete_volume" :: waited 0.034s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:00 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fbf7df-bed9-4094-ac2b-7ba4f425ba60]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:00 devstack sudo[104308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e
Aug 12 16:27:00 devstack sudo[104308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:00 devstack sudo[104308]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e" returned: 0 in 0.711s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:00 devstack sudo[104314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e
Aug 12 16:27:00 devstack sudo[104314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:01 devstack sudo[104314]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db628fb5-2119-4c09-824a-1ea195f7fe0e" returned: 0 in 0.534s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:01 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] Lock "cinder-quobyte-db628fb5-2119-4c09-824a-1ea195f7fe0e" released by "delete_volume" :: held 1.397s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:01 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] Created reservations ['fb6551ae-7666-4a96-94ca-97743b6e1993', 'a75639ba-00c4-4739-87e0-774be6d29b26', 'b37f68ba-61f9-4732-82c9-7df0185f7e9c', '43c71053-9db7-4f92-8f12-9723392b2926'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:27:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:27:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:27:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:01 devstack sudo[104338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:27:01 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:02 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.392s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:02 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:27:02 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] Deleted volume successfully.
Aug 12 16:27:02 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-82a57414-b4b8-4c68-a749-4adfc8caa738 tempest-SnapshotMetadataTestJSON-1220739535 None] Lock "cinder-db628fb5-2119-4c09-824a-1ea195f7fe0e-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] Acquiring lock "cinder-a74eb022-e061-44aa-8753-009541fc7d72-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] Lock "cinder-a74eb022-e061-44aa-8753-009541fc7d72-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] Acquiring lock "cinder-quobyte-a74eb022-e061-44aa-8753-009541fc7d72" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] Lock "cinder-quobyte-a74eb022-e061-44aa-8753-009541fc7d72" acquired by "delete_volume" :: waited 0.060s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:06 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[244bde68-65dd-420c-8a32-e3457b56da80]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a74eb022-e061-44aa-8753-009541fc7d72 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:06 devstack sudo[104347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a74eb022-e061-44aa-8753-009541fc7d72
Aug 12 16:27:06 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:06 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a74eb022-e061-44aa-8753-009541fc7d72" returned: 0 in 0.664s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a74eb022-e061-44aa-8753-009541fc7d72 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:06 devstack sudo[104353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a74eb022-e061-44aa-8753-009541fc7d72
Aug 12 16:27:06 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:07 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a74eb022-e061-44aa-8753-009541fc7d72" returned: 0 in 0.552s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] Lock "cinder-quobyte-a74eb022-e061-44aa-8753-009541fc7d72" released by "delete_volume" :: held 1.269s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] Created reservations ['422ff10c-f04e-4112-b728-1357adabb072', '5084815c-ef82-40ef-a0cb-e505e27d54f4', '46cca4c9-bd7f-478f-9195-82971a5b11d8', '419e217a-839d-49c3-97f3-5645cbc0e502'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:07 devstack sudo[104356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:27:07 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Flow 'volume_create_manager' (38f5576b-a54c-4b85-8e98-eca7dc2174e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929111fd-6d2f-4450-819c-86ca8d21a68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929111fd-6d2f-4450-819c-86ca8d21a68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-958657336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4eeb70-79cc-40d7-98ea-77e05f7d0e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ae29fec6627434997252ac1827645f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:27:08Z,use_quota=True,user_id='3c7523ae1dec479f8b68c2e8c405c196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ac2526-c951-4dc1-96ac-3eb92a6dcd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8ac2526-c951-4dc1-96ac-3eb92a6dcd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d812396-73c9-4565-b491-750be098f4d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d812396-73c9-4565-b491-750be098f4d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db4eeb70-79cc-40d7-98ea-77e05f7d0e6d', 'volume_name': 'volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad821e16-f076-46b6-aee5-751c57c00b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad821e16-f076-46b6-aee5-751c57c00b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87900fd1-a945-46d8-932f-e680523869d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:07 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Volume db4eeb70-79cc-40d7-98ea-77e05f7d0e6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d', 'volume_size': 1}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-958657336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4eeb70-79cc-40d7-98ea-77e05f7d0e6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ae29fec6627434997252ac1827645f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:27:08Z,use_quota=True,user_id='3c7523ae1dec479f8b68c2e8c405c196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Creating volume db4eeb70-79cc-40d7-98ea-77e05f7d0e6d {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:27:07 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:27:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:07 devstack sudo[104358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d 1073741824
Aug 12 16:27:07 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:08 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.391s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:08 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:27:08 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] Deleted volume successfully.
Aug 12 16:27:08 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8abb3a1-8e55-4c25-8378-13f4b9470d93 tempest-AttachVolumeTestJSON-2133361617 None] Lock "cinder-a74eb022-e061-44aa-8753-009541fc7d72-delete_volume" released by "delete_volume" :: held 2.017s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:08 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d 1073741824" returned: 0 in 0.575s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:08 devstack sudo[104365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d
Aug 12 16:27:08 devstack sudo[104365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:08 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] Acquiring lock "cinder-21dd8786-4461-4f1f-a87d-22c48c844aee-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:08 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] Lock "cinder-21dd8786-4461-4f1f-a87d-22c48c844aee-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:08 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] Acquiring lock "cinder-quobyte-21dd8786-4461-4f1f-a87d-22c48c844aee" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:08 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] Lock "cinder-quobyte-21dd8786-4461-4f1f-a87d-22c48c844aee" acquired by "delete_volume" :: waited 0.025s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:08 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25ad610-688b-431e-adab-6338e0d3b587]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21dd8786-4461-4f1f-a87d-22c48c844aee {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:08 devstack sudo[104365]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d" returned: 0 in 0.402s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:27:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87900fd1-a945-46d8-932f-e680523869d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079f507b-d22b-4293-98e8-07d0d4dbc98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:08 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Volume volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d (db4eeb70-79cc-40d7-98ea-77e05f7d0e6d): created successfully
Aug 12 16:27:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (079f507b-d22b-4293-98e8-07d0d4dbc98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Flow 'volume_create_manager' (38f5576b-a54c-4b85-8e98-eca7dc2174e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:27:08 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-8794f048-1fe1-466a-8f91-2a9b80befde4 tempest-VolumesCloneTest-2129232130 None] Created volume successfully.
Aug 12 16:27:08 devstack sudo[104367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21dd8786-4461-4f1f-a87d-22c48c844aee
Aug 12 16:27:08 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:09 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21dd8786-4461-4f1f-a87d-22c48c844aee" returned: 0 in 0.488s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21dd8786-4461-4f1f-a87d-22c48c844aee {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:09 devstack sudo[104373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21dd8786-4461-4f1f-a87d-22c48c844aee
Aug 12 16:27:09 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:09 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-21dd8786-4461-4f1f-a87d-22c48c844aee" returned: 0 in 0.269s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] Lock "cinder-quobyte-21dd8786-4461-4f1f-a87d-22c48c844aee" released by "delete_volume" :: held 0.804s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:09 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] Created reservations ['ae174730-4248-480f-9e69-90fea76def6d', 'dcd0657b-a47f-4b74-932e-110dda9ffbf1', '6caba286-52eb-4d1f-bc8e-439b79d0995a', '693757bb-02c8-4e68-9ffb-3111f0babc67'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:27:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:27:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:27:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:09 devstack sudo[104377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:27:09 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] Acquiring lock "cinder-42622a7e-9959-48aa-b595-079339905f35-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] Lock "cinder-42622a7e-9959-48aa-b595-079339905f35-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] Acquiring lock "cinder-quobyte-42622a7e-9959-48aa-b595-079339905f35" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] Lock "cinder-quobyte-42622a7e-9959-48aa-b595-079339905f35" acquired by "delete_volume" :: waited 0.029s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e3df73-9cd9-447e-a5ce-591bc481b11f]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-42622a7e-9959-48aa-b595-079339905f35 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:10 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.466s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:27:10 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] Deleted volume successfully.
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-599b7d86-c18a-4db6-9538-9f72e51ea196 tempest-AttachVolumeTestJSON-2133361617 None] Lock "cinder-21dd8786-4461-4f1f-a87d-22c48c844aee-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:10 devstack sudo[104381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-42622a7e-9959-48aa-b595-079339905f35
Aug 12 16:27:10 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Flow 'volume_create_manager' (2210fa4c-6b34-4ad2-a3f6-471effafa273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4637ffb0-f4ee-4c34-9c03-d4233a584162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4637ffb0-f4ee-4c34-9c03-d4233a584162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1167079879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a54672cb-068b-4fd6-8462-aaa0cd3c344a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ae29fec6627434997252ac1827645f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:27:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=db4eeb70-79cc-40d7-98ea-77e05f7d0e6d,status='creating',terminated_at=None,updated_at=2026-08-12T14:27:11Z,use_quota=True,user_id='3c7523ae1dec479f8b68c2e8c405c196',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff31a797-20bf-4107-9776-7e9924a535eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff31a797-20bf-4107-9776-7e9924a535eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea993fa-3606-4d75-a92c-6b57879b725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea993fa-3606-4d75-a92c-6b57879b725f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a54672cb-068b-4fd6-8462-aaa0cd3c344a', 'volume_name': 'volume-a54672cb-068b-4fd6-8462-aaa0cd3c344a', 'volume_size': 2, 'source_volid': 'db4eeb70-79cc-40d7-98ea-77e05f7d0e6d', 'source_volstatus': 'available'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:10 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead88c9b-212e-4aaa-a623-d52ad21b60b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead88c9b-212e-4aaa-a623-d52ad21b60b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3902139-fa37-4089-b968-00084a1d9874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:10 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Volume a54672cb-068b-4fd6-8462-aaa0cd3c344a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a54672cb-068b-4fd6-8462-aaa0cd3c344a', 'volume_size': 2, 'source_volid': 'db4eeb70-79cc-40d7-98ea-77e05f7d0e6d', 'source_volstatus': 'available'}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-42622a7e-9959-48aa-b595-079339905f35" returned: 0 in 0.670s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-42622a7e-9959-48aa-b595-079339905f35 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:10 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Cloning volume db4eeb70-79cc-40d7-98ea-77e05f7d0e6d to volume a54672cb-068b-4fd6-8462-aaa0cd3c344a
Aug 12 16:27:10 devstack sudo[104401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-42622a7e-9959-48aa-b595-079339905f35
Aug 12 16:27:10 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Creating offline snapshot a761f733-682d-4b0d-ab17-659c089ecf3f of volume db4eeb70-79cc-40d7-98ea-77e05f7d0e6d {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac442a6-9d35-4e99-907e-59dacc93877f]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:11 devstack sudo[104403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d
Aug 12 16:27:11 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:11 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-42622a7e-9959-48aa-b595-079339905f35" returned: 0 in 0.333s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] Lock "cinder-quobyte-42622a7e-9959-48aa-b595-079339905f35" released by "delete_volume" :: held 1.072s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:11 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] Created reservations ['56f55172-7d5b-4017-bb0c-633ec802f93b', '0f1ab23b-c0cb-4070-a00c-d82a32a4e910', 'e5c5ae95-2952-4d7a-b027-96788b145da3', 'b985ecba-9fe5-4e68-ae17-a0678d965d25'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:27:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:27:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:27:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:11 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d" returned: 0 in 0.431s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:11 devstack sudo[104409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:27:11 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:11 devstack sudo[104410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f 1G
Aug 12 16:27:11 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:11 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.259s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:11 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:27:11 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] Deleted volume successfully.
Aug 12 16:27:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-55b17c91-caa7-4628-b2e0-b6955f518396 tempest-AttachVolumeTestJSON-2133361617 None] Lock "cinder-42622a7e-9959-48aa-b595-079339905f35-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:11 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f 1G" returned: 0 in 0.514s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:11 devstack sudo[104418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f
Aug 12 16:27:11 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:12 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f" returned: 0 in 0.343s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:12 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f is being set with open permissions: ugo+rw
Aug 12 16:27:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:12 devstack sudo[104423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f
Aug 12 16:27:12 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:12 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f" returned: 0 in 0.268s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:12 devstack sudo[104426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.info
Aug 12 16:27:12 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:12 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.info" returned: 0 in 0.288s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:12 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.info is being set with open permissions: ugo+rw
Aug 12 16:27:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:12 devstack sudo[104429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.info
Aug 12 16:27:12 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:13 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.info" returned: 0 in 0.317s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Acquiring lock "cinder-quobyte-a54672cb-068b-4fd6-8462-aaa0cd3c344a" by "_copy_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Lock "cinder-quobyte-a54672cb-068b-4fd6-8462-aaa0cd3c344a" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] snapshot: a761f733-682d-4b0d-ab17-659c089ecf3f, volume: a54672cb-068b-4fd6-8462-aaa0cd3c344a,  {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 12 16:27:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:27:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:27:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:13 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc129f2-9544-4649-b788-ca498dc0b3f1]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:13 devstack sudo[104432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f
Aug 12 16:27:13 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:13 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f" returned: 0 in 0.412s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:27:13 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[237899ca-254d-4183-9716-2caef5e95ca0]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:13 devstack sudo[104438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d
Aug 12 16:27:13 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:14 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d" returned: 0 in 0.462s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 12 16:27:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Creating direct copy from snapshot {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 12 16:27:14 devstack cinder-volume[94457]: DEBUG cinder.utils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Path /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a54672cb-068b-4fd6-8462-aaa0cd3c344a not found in is_blk_device check {{(pid=94457) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 12 16:27:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a54672cb-068b-4fd6-8462-aaa0cd3c344a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:14 devstack sudo[104444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a54672cb-068b-4fd6-8462-aaa0cd3c344a
Aug 12 16:27:14 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:27:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:27:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:27:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:19 devstack sudo[104471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:27:19 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:20 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.564s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:20 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:27:20 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:27:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 28 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:27:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:27:20 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a54672cb-068b-4fd6-8462-aaa0cd3c344a" returned: 0 in 6.331s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:20 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d, size 1024.00 MB, duration 6.33 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a54672cb-068b-4fd6-8462-aaa0cd3c344a {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:27:20 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Converted 1024.00 MB image at 161.67 MB/s
Aug 12 16:27:20 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a54672cb-068b-4fd6-8462-aaa0cd3c344a is being set with open permissions: ugo+rw
Aug 12 16:27:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a54672cb-068b-4fd6-8462-aaa0cd3c344a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:20 devstack sudo[104498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a54672cb-068b-4fd6-8462-aaa0cd3c344a
Aug 12 16:27:20 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:20 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a54672cb-068b-4fd6-8462-aaa0cd3c344a" returned: 0 in 0.310s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:20 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Lock "cinder-quobyte-a54672cb-068b-4fd6-8462-aaa0cd3c344a" released by "_copy_volume_from_snapshot" :: held 7.602s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:20 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Acquiring lock "cinder-quobyte-a761f733-682d-4b0d-ab17-659c089ecf3f" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:20 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Lock "cinder-quobyte-a761f733-682d-4b0d-ab17-659c089ecf3f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Deleting offline snapshot a761f733-682d-4b0d-ab17-659c089ecf3f of volume db4eeb70-79cc-40d7-98ea-77e05f7d0e6d {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:27:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] snapshot_file for this snap is: volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:27:20 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ad9a71-8910-4046-8ae3-97934aa96b92]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:21 devstack sudo[104501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f
Aug 12 16:27:21 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:21 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f" returned: 0 in 0.463s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:27:21 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[79988be4-c87b-4d1f-a555-d84003571898]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:21 devstack sudo[104506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d
Aug 12 16:27:21 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:22 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d" returned: 0 in 0.660s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:22 devstack sudo[104511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f
Aug 12 16:27:22 devstack sudo[104511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:22 devstack sudo[104511]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f" returned: 0 in 0.397s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:22 devstack sudo[104517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f
Aug 12 16:27:22 devstack sudo[104517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Flow 'volume_create_manager' (28d2c17a-496d-49f0-93b5-d32beaa0c057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3203c08-070b-4c72-8e1c-2d1a5d185251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3203c08-070b-4c72-8e1c-2d1a5d185251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1023313144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78647862-ecc5-4d7f-b6b5-9384fa40ed8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2151c439c5954ba59861b3140396c854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:27:22Z,use_quota=True,user_id='c9de3271cf524e6b817a6bcd3eebb286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e17eb5c-450e-4a3b-aa91-4fbbb50dcce6),volume_type_id=2e17eb5c-450e-4a3b-aa91-4fbbb50dcce6)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a4fdea-61bd-4435-878b-6bf5d3188b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a4fdea-61bd-4435-878b-6bf5d3188b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875c6aac-f9d4-422f-a1b9-7f06116077cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (875c6aac-f9d4-422f-a1b9-7f06116077cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78647862-ecc5-4d7f-b6b5-9384fa40ed8a', 'volume_name': 'volume-78647862-ecc5-4d7f-b6b5-9384fa40ed8a', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d45979-aeeb-4670-b7d0-71b5efa202f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d45979-aeeb-4670-b7d0-71b5efa202f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14d9b4a-f42a-497d-856f-90e97e1a6610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:22 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Volume 78647862-ecc5-4d7f-b6b5-9384fa40ed8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78647862-ecc5-4d7f-b6b5-9384fa40ed8a', 'volume_size': 1}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:22 devstack sudo[104517]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d.a761f733-682d-4b0d-ab17-659c089ecf3f" returned: 0 in 0.290s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Lock "cinder-quobyte-a761f733-682d-4b0d-ab17-659c089ecf3f" released by "_delete_snapshot" :: held 1.944s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.985s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.260s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1023313144',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78647862-ecc5-4d7f-b6b5-9384fa40ed8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2151c439c5954ba59861b3140396c854',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:27:22Z,use_quota=True,user_id='c9de3271cf524e6b817a6bcd3eebb286',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e17eb5c-450e-4a3b-aa91-4fbbb50dcce6),volume_type_id=2e17eb5c-450e-4a3b-aa91-4fbbb50dcce6)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Creating volume 78647862-ecc5-4d7f-b6b5-9384fa40ed8a {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:27:22 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-78647862-ecc5-4d7f-b6b5-9384fa40ed8a 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:22 devstack sudo[104520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-78647862-ecc5-4d7f-b6b5-9384fa40ed8a 1073741824
Aug 12 16:27:22 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3902139-fa37-4089-b968-00084a1d9874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a54672cb-068b-4fd6-8462-aaa0cd3c344a', 'volume_size': 2, 'source_volid': 'db4eeb70-79cc-40d7-98ea-77e05f7d0e6d', 'source_volstatus': 'available'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c32aad-d0b5-40ca-aea5-36869dc11b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:22 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Volume volume-a54672cb-068b-4fd6-8462-aaa0cd3c344a (a54672cb-068b-4fd6-8462-aaa0cd3c344a): created successfully
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02c32aad-d0b5-40ca-aea5-36869dc11b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Flow 'volume_create_manager' (2210fa4c-6b34-4ad2-a3f6-471effafa273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:27:22 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-d7769700-b46e-4877-9e35-060b1c6b161b tempest-VolumesCloneTest-2129232130 None] Created volume successfully.
Aug 12 16:27:23 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-78647862-ecc5-4d7f-b6b5-9384fa40ed8a 1073741824" returned: 0 in 0.479s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-78647862-ecc5-4d7f-b6b5-9384fa40ed8a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:23 devstack sudo[104526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-78647862-ecc5-4d7f-b6b5-9384fa40ed8a
Aug 12 16:27:23 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:23 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-78647862-ecc5-4d7f-b6b5-9384fa40ed8a" returned: 0 in 0.246s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:27:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e14d9b4a-f42a-497d-856f-90e97e1a6610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78647862-ecc5-4d7f-b6b5-9384fa40ed8a', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8efac9-a63e-4a2f-8923-4b9feae29cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:23 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Volume volume-78647862-ecc5-4d7f-b6b5-9384fa40ed8a (78647862-ecc5-4d7f-b6b5-9384fa40ed8a): created successfully
Aug 12 16:27:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e8efac9-a63e-4a2f-8923-4b9feae29cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Flow 'volume_create_manager' (28d2c17a-496d-49f0-93b5-d32beaa0c057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:27:23 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-cf24f67f-76fc-4ba9-91f7-98f81d1210ce tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Created volume successfully.
Aug 12 16:27:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] Acquiring lock "cinder-a54672cb-068b-4fd6-8462-aaa0cd3c344a-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] Lock "cinder-a54672cb-068b-4fd6-8462-aaa0cd3c344a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] Acquiring lock "cinder-quobyte-a54672cb-068b-4fd6-8462-aaa0cd3c344a" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] Lock "cinder-quobyte-a54672cb-068b-4fd6-8462-aaa0cd3c344a" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:24 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[9217f58b-846d-4186-96a8-7c0e1e57ce6a]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a54672cb-068b-4fd6-8462-aaa0cd3c344a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:24 devstack sudo[104529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a54672cb-068b-4fd6-8462-aaa0cd3c344a
Aug 12 16:27:24 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:24 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a54672cb-068b-4fd6-8462-aaa0cd3c344a" returned: 0 in 0.401s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a54672cb-068b-4fd6-8462-aaa0cd3c344a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:24 devstack sudo[104535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a54672cb-068b-4fd6-8462-aaa0cd3c344a
Aug 12 16:27:24 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:24 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a54672cb-068b-4fd6-8462-aaa0cd3c344a" returned: 0 in 0.292s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] Lock "cinder-quobyte-a54672cb-068b-4fd6-8462-aaa0cd3c344a" released by "delete_volume" :: held 0.740s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:24 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] Created reservations ['306b8aad-339a-4e07-8e43-d25955a66938', '217575c9-66c0-4344-aa07-41bb59663f06', '2d12592b-36ea-4cab-bea6-5d9082147d18', '80d88099-c808-4301-a2a6-f7a67dbb4090'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:25 devstack sudo[104542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a265fb13-2761-43c2-b9c3-20e120a4ad20 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a265fb13-2761-43c2-b9c3-20e120a4ad20 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a265fb13-2761-43c2-b9c3-20e120a4ad20 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:27:25 devstack sudo[104542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a265fb13-2761-43c2-b9c3-20e120a4ad20 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a265fb13-2761-43c2-b9c3-20e120a4ad20 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a265fb13-2761-43c2-b9c3-20e120a4ad20 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:25 devstack sudo[104544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:27:25 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] Acquiring lock "cinder-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] Lock "cinder-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] Acquiring lock "cinder-quobyte-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] Lock "cinder-quobyte-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d" acquired by "delete_volume" :: waited 0.033s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:25 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:25 devstack sudo[104542]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.478s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a265fb13-2761-43c2-b9c3-20e120a4ad20 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.448s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-a265fb13-2761-43c2-b9c3-20e120a4ad20 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[990206ae-a66a-429d-b029-8b76ac1be41c]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:25 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] Deleted volume successfully.
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:25 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a265fb13-2761-43c2-b9c3-20e120a4ad20 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Retype volume completed successfully.
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-355372e0-4113-402a-96b9-fc2ab5327362 tempest-VolumesCloneTest-2129232130 None] Lock "cinder-a54672cb-068b-4fd6-8462-aaa0cd3c344a-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:25 devstack sudo[104552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d
Aug 12 16:27:25 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:25 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d" returned: 0 in 0.461s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:26 devstack sudo[104559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d
Aug 12 16:27:26 devstack sudo[104559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:26 devstack sudo[104559]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d" returned: 0 in 0.286s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] Lock "cinder-quobyte-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d" released by "delete_volume" :: held 0.874s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Acquiring lock "cinder-78647862-ecc5-4d7f-b6b5-9384fa40ed8a-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Lock "cinder-78647862-ecc5-4d7f-b6b5-9384fa40ed8a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-09bcbbfb-7c7a-40d1-8308-4365120a5f48 req-4cec8763-6299-4214-a3fc-f38aa7f3bf6c tempest-TestStampPattern-411757869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-09bcbbfb-7c7a-40d1-8308-4365120a5f48 req-4cec8763-6299-4214-a3fc-f38aa7f3bf6c tempest-TestStampPattern-411757869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] Created reservations ['4aaa772a-b23e-48b0-9552-a3a0eb52cd9a', '3ebf2e8b-515f-4bee-b9f6-d6cabb1aeed4', '008f692e-0954-402b-8dbc-690005ce5739', '1638803c-5979-4881-8704-4ad12d12cdfb'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Acquiring lock "cinder-quobyte-78647862-ecc5-4d7f-b6b5-9384fa40ed8a" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-09bcbbfb-7c7a-40d1-8308-4365120a5f48 req-4cec8763-6299-4214-a3fc-f38aa7f3bf6c tempest-TestStampPattern-411757869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.045s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Lock "cinder-quobyte-78647862-ecc5-4d7f-b6b5-9384fa40ed8a" acquired by "delete_volume" :: waited 0.046s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d437226-e310-4a4e-84b2-0c3aae2638ed]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-78647862-ecc5-4d7f-b6b5-9384fa40ed8a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-09bcbbfb-7c7a-40d1-8308-4365120a5f48 req-4cec8763-6299-4214-a3fc-f38aa7f3bf6c tempest-TestStampPattern-411757869 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae58f98f-e1cf-41bb-a2c7-478fde159ca8', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:26 devstack sudo[104571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:27:26 devstack sudo[104571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:26 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-09bcbbfb-7c7a-40d1-8308-4365120a5f48 req-4cec8763-6299-4214-a3fc-f38aa7f3bf6c tempest-TestStampPattern-411757869 None] attachment_update completed successfully.
Aug 12 16:27:26 devstack sudo[104570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-78647862-ecc5-4d7f-b6b5-9384fa40ed8a
Aug 12 16:27:26 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:26 devstack sudo[104571]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.336s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:26 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:27:26 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] Deleted volume successfully.
Aug 12 16:27:27 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e6b3461e-0b18-4f4b-8fb7-dcbd8673b319 tempest-VolumesCloneTest-2129232130 None] Lock "cinder-db4eeb70-79cc-40d7-98ea-77e05f7d0e6d-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:27 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-78647862-ecc5-4d7f-b6b5-9384fa40ed8a" returned: 0 in 0.547s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-78647862-ecc5-4d7f-b6b5-9384fa40ed8a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:27 devstack sudo[104646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-78647862-ecc5-4d7f-b6b5-9384fa40ed8a
Aug 12 16:27:27 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:27 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-78647862-ecc5-4d7f-b6b5-9384fa40ed8a" returned: 0 in 0.285s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:27 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Lock "cinder-quobyte-78647862-ecc5-4d7f-b6b5-9384fa40ed8a" released by "delete_volume" :: held 0.882s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:27 devstack cinder-volume[94457]: WARNING cinder.quota [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:27:27 devstack cinder-volume[94457]: WARNING cinder.quota [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:27:27 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Created reservations ['79c45714-62af-48a4-8e36-7f728bd9db31', 'f50f31fc-9e0f-478d-a361-9824e5da33bb', 'b188bcbb-24a8-4e94-8fa0-64e8422e012c', '14b9e117-6848-4eb3-aca9-ad252c47d18a'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:27:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:27:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:27:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:27 devstack sudo[104966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:27:27 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:27 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.330s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:27 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:27:27 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Deleted volume successfully.
Aug 12 16:27:27 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5b42e5ff-c628-4559-924e-fbc1560c5609 tempest-VolumeRetypeWithoutMigrationTest-2034587283 None] Lock "cinder-78647862-ecc5-4d7f-b6b5-9384fa40ed8a-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=132,cinder:INSERT=35,cinder:UPDATE=156,cinder:DELETE=7 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=143,cinder:INSERT=35,cinder:UPDATE=141,cinder:DELETE=9 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Flow 'volume_create_manager' (cad0be6c-4ba9-44ae-97a7-410fc6b71435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ecd2da-1be2-4665-8eea-fe33ef59b4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ecd2da-1be2-4665-8eea-fe33ef59b4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1749942936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a31657ec80d4ad586f7e8284d32ec89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:27:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:27:32Z,use_quota=True,user_id='0f500f11f8924341a7e8a031bccc7120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e020c12-3d16-4cb3-a1bc-dbecaff77bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e020c12-3d16-4cb3-a1bc-dbecaff77bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506faeb7-f8fd-4afa-82fa-f410b9c88e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506faeb7-f8fd-4afa-82fa-f410b9c88e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e', 'volume_name': 'volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e', 'volume_size': 2}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40d5314-9fc6-4552-95f6-372afebb8baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a40d5314-9fc6-4552-95f6-372afebb8baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c797723-7ad8-4168-b8ea-cf0bb281256d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:32 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Volume 9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e', 'volume_size': 2}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1749942936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a31657ec80d4ad586f7e8284d32ec89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:27:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:27:32Z,use_quota=True,user_id='0f500f11f8924341a7e8a031bccc7120',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Creating volume 9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:27:32 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e 2147483648 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:32 devstack sudo[105004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e 2147483648
Aug 12 16:27:32 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:32 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-c2d2d07f-085a-4664-878a-214fd738f81e req-dbfd34bc-928c-4ddd-8be6-b60a20ba7431 tempest-TestStampPattern-411757869 None] Terminate volume connection completed successfully.
Aug 12 16:27:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-c2d2d07f-085a-4664-878a-214fd738f81e req-dbfd34bc-928c-4ddd-8be6-b60a20ba7431 tempest-TestStampPattern-411757869 None] Deleting attachment ae58f98f-e1cf-41bb-a2c7-478fde159ca8. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:27:33 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e 2147483648" returned: 0 in 0.718s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:33 devstack sudo[105035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e
Aug 12 16:27:33 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a27c1cbe-20ad-403c-8336-d211a6a5927a tempest-TestStampPattern-411757869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:33 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e" returned: 0 in 0.335s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:27:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a27c1cbe-20ad-403c-8336-d211a6a5927a tempest-TestStampPattern-411757869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.145s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c797723-7ad8-4168-b8ea-cf0bb281256d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e', 'volume_size': 2}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4640106-c1f9-42ae-ba16-8b795080de0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-a27c1cbe-20ad-403c-8336-d211a6a5927a tempest-TestStampPattern-411757869 None] Creating offline snapshot 679cba59-5334-4379-adea-4fda93aab5c6 of volume b51c4b73-324d-4e0a-89c3-1a02d07dd7bb {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:27:33 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Volume volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e (9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e): created successfully
Aug 12 16:27:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4640106-c1f9-42ae-ba16-8b795080de0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Flow 'volume_create_manager' (cad0be6c-4ba9-44ae-97a7-410fc6b71435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:27:33 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ce5e73-0534-4f61-8d39-84bfa87b7a1a]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a27c1cbe-20ad-403c-8336-d211a6a5927a tempest-TestStampPattern-411757869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:33 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-109de3fb-a5d7-453b-8e0f-65af824a0891 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Created volume successfully.
Aug 12 16:27:33 devstack sudo[105038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb
Aug 12 16:27:33 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:34 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a27c1cbe-20ad-403c-8336-d211a6a5927a tempest-TestStampPattern-411757869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb" returned: 0 in 0.453s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a27c1cbe-20ad-403c-8336-d211a6a5927a tempest-TestStampPattern-411757869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:34 devstack sudo[105043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6 1G
Aug 12 16:27:34 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5fa4289d-8414-4b5f-a862-539a1c270d76 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:34 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a27c1cbe-20ad-403c-8336-d211a6a5927a tempest-TestStampPattern-411757869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6 1G" returned: 0 in 0.564s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a27c1cbe-20ad-403c-8336-d211a6a5927a tempest-TestStampPattern-411757869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:34 devstack sudo[105049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6
Aug 12 16:27:34 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:35 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a27c1cbe-20ad-403c-8336-d211a6a5927a tempest-TestStampPattern-411757869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6" returned: 0 in 0.375s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:35 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-a27c1cbe-20ad-403c-8336-d211a6a5927a tempest-TestStampPattern-411757869 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6 is being set with open permissions: ugo+rw
Aug 12 16:27:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a27c1cbe-20ad-403c-8336-d211a6a5927a tempest-TestStampPattern-411757869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:35 devstack sudo[105055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6
Aug 12 16:27:35 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:35 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a27c1cbe-20ad-403c-8336-d211a6a5927a tempest-TestStampPattern-411757869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6" returned: 0 in 0.277s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a27c1cbe-20ad-403c-8336-d211a6a5927a tempest-TestStampPattern-411757869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:35 devstack sudo[105058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.info
Aug 12 16:27:35 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:35 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a27c1cbe-20ad-403c-8336-d211a6a5927a tempest-TestStampPattern-411757869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.info" returned: 0 in 0.283s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:35 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-a27c1cbe-20ad-403c-8336-d211a6a5927a tempest-TestStampPattern-411757869 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.info is being set with open permissions: ugo+rw
Aug 12 16:27:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a27c1cbe-20ad-403c-8336-d211a6a5927a tempest-TestStampPattern-411757869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:35 devstack sudo[105061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.info
Aug 12 16:27:35 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:36 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a27c1cbe-20ad-403c-8336-d211a6a5927a tempest-TestStampPattern-411757869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.info" returned: 0 in 0.307s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a27c1cbe-20ad-403c-8336-d211a6a5927a tempest-TestStampPattern-411757869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.408s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5fa4289d-8414-4b5f-a862-539a1c270d76 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.376s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5fa4289d-8414-4b5f-a862-539a1c270d76 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Creating offline snapshot 612d20a4-c80a-4f23-baf4-cbd508e91ceb of volume 9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:27:36 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a27c1cbe-20ad-403c-8336-d211a6a5927a tempest-TestStampPattern-411757869 None] Create snapshot completed successfully
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[760f4c90-7446-4349-90d4-d9721d655b3b]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5fa4289d-8414-4b5f-a862-539a1c270d76 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Flow 'volume_create_manager' (f9542018-a07f-4046-9a8f-176577476251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f5200d-3183-4c3c-a562-51a857b89d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f5200d-3183-4c3c-a562-51a857b89d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1434526760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef9cdc61-7a10-45e9-97a2-f45df3ca9536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='462b6d696d244305b873774fb094af5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:27:36Z,use_quota=True,user_id='4c9292aeecd44f619b072de222af487a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b022c9-1114-4dc1-b181-a1fa0993a7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b022c9-1114-4dc1-b181-a1fa0993a7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f6d463-e9ee-4343-b011-286ea177c8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53f6d463-e9ee-4343-b011-286ea177c8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef9cdc61-7a10-45e9-97a2-f45df3ca9536', 'volume_name': 'volume-ef9cdc61-7a10-45e9-97a2-f45df3ca9536', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85c99a9-27c2-4842-b83b-06d3560aa898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85c99a9-27c2-4842-b83b-06d3560aa898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da20e25-d0ce-4e46-ba6a-179e7b5b80e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:36 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Volume ef9cdc61-7a10-45e9-97a2-f45df3ca9536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef9cdc61-7a10-45e9-97a2-f45df3ca9536', 'volume_size': 1}
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:36 devstack sudo[105064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e
Aug 12 16:27:36 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:36 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5fa4289d-8414-4b5f-a862-539a1c270d76 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e" returned: 0 in 0.457s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5fa4289d-8414-4b5f-a862-539a1c270d76 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb 2G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:36 devstack sudo[105069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb 2G
Aug 12 16:27:36 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:37 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5fa4289d-8414-4b5f-a862-539a1c270d76 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb 2G" returned: 0 in 0.475s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5fa4289d-8414-4b5f-a862-539a1c270d76 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:37 devstack sudo[105075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb
Aug 12 16:27:37 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:37 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5fa4289d-8414-4b5f-a862-539a1c270d76 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb" returned: 0 in 0.363s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:37 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-5fa4289d-8414-4b5f-a862-539a1c270d76 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb is being set with open permissions: ugo+rw
Aug 12 16:27:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5fa4289d-8414-4b5f-a862-539a1c270d76 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:37 devstack sudo[105081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb
Aug 12 16:27:37 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:37 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5fa4289d-8414-4b5f-a862-539a1c270d76 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb" returned: 0 in 0.277s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5fa4289d-8414-4b5f-a862-539a1c270d76 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:37 devstack sudo[105084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.info
Aug 12 16:27:37 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:38 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5fa4289d-8414-4b5f-a862-539a1c270d76 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.info" returned: 0 in 0.375s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:38 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-5fa4289d-8414-4b5f-a862-539a1c270d76 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.info is being set with open permissions: ugo+rw
Aug 12 16:27:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5fa4289d-8414-4b5f-a862-539a1c270d76 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:38 devstack sudo[105088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.info
Aug 12 16:27:38 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:38 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5fa4289d-8414-4b5f-a862-539a1c270d76 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.info" returned: 0 in 0.315s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5fa4289d-8414-4b5f-a862-539a1c270d76 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.401s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.222s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:27:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1434526760',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef9cdc61-7a10-45e9-97a2-f45df3ca9536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='462b6d696d244305b873774fb094af5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:27:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:27:36Z,use_quota=True,user_id='4c9292aeecd44f619b072de222af487a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:27:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Creating volume ef9cdc61-7a10-45e9-97a2-f45df3ca9536 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:27:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:27:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:27:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:27:38 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:27:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ef9cdc61-7a10-45e9-97a2-f45df3ca9536 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:38 devstack sudo[105095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ef9cdc61-7a10-45e9-97a2-f45df3ca9536 1073741824
Aug 12 16:27:38 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:38 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5fa4289d-8414-4b5f-a862-539a1c270d76 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Create snapshot completed successfully
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Acquiring lock "cinder-612d20a4-c80a-4f23-baf4-cbd508e91ceb-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Lock "cinder-612d20a4-c80a-4f23-baf4-cbd508e91ceb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Acquiring lock "cinder-quobyte-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:39 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Lock "cinder-quobyte-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Acquiring lock "cinder-quobyte-612d20a4-c80a-4f23-baf4-cbd508e91ceb" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ef9cdc61-7a10-45e9-97a2-f45df3ca9536 1073741824" returned: 0 in 0.632s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Lock "cinder-quobyte-612d20a4-c80a-4f23-baf4-cbd508e91ceb" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Deleting offline snapshot 612d20a4-c80a-4f23-baf4-cbd508e91ceb of volume 9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] snapshot_file for this snap is: volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[0487e5e1-0076-4c17-b781-7afcb484a79f]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ef9cdc61-7a10-45e9-97a2-f45df3ca9536 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:39 devstack sudo[105119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ef9cdc61-7a10-45e9-97a2-f45df3ca9536
Aug 12 16:27:39 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:39 devstack sudo[105116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb
Aug 12 16:27:39 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:39 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ef9cdc61-7a10-45e9-97a2-f45df3ca9536" returned: 0 in 0.367s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da20e25-d0ce-4e46-ba6a-179e7b5b80e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef9cdc61-7a10-45e9-97a2-f45df3ca9536', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934df374-c4d5-4087-ba7b-1d9f24d0e22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:39 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Volume volume-ef9cdc61-7a10-45e9-97a2-f45df3ca9536 (ef9cdc61-7a10-45e9-97a2-f45df3ca9536): created successfully
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934df374-c4d5-4087-ba7b-1d9f24d0e22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:39 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Flow 'volume_create_manager' (f9542018-a07f-4046-9a8f-176577476251) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb" returned: 0 in 0.464s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:27:39 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c4883c22-7fc6-4ef0-b7c2-277bdb398a32 tempest-VolumesServicesTestJSON-1987373377 None] Created volume successfully.
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f5c0b9-c07f-4189-9132-9c9d0a5f27cc]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:39 devstack sudo[105127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e
Aug 12 16:27:39 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:40 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e" returned: 0 in 0.380s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:40 devstack sudo[105142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb
Aug 12 16:27:40 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:40 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb" returned: 0 in 0.516s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:40 devstack sudo[105149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb
Aug 12 16:27:40 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] Acquiring lock "cinder-ef9cdc61-7a10-45e9-97a2-f45df3ca9536-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] Lock "cinder-ef9cdc61-7a10-45e9-97a2-f45df3ca9536-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] Acquiring lock "cinder-quobyte-ef9cdc61-7a10-45e9-97a2-f45df3ca9536" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] Lock "cinder-quobyte-ef9cdc61-7a10-45e9-97a2-f45df3ca9536" acquired by "delete_volume" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:40 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d86922-40d3-44e0-9da5-1bfeff793e90]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ef9cdc61-7a10-45e9-97a2-f45df3ca9536 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:40 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e.612d20a4-c80a-4f23-baf4-cbd508e91ceb" returned: 0 in 0.354s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:41 devstack sudo[105151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ef9cdc61-7a10-45e9-97a2-f45df3ca9536
Aug 12 16:27:41 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Lock "cinder-quobyte-612d20a4-c80a-4f23-baf4-cbd508e91ceb" released by "_delete_snapshot" :: held 1.875s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Lock "cinder-quobyte-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e" released by "delete_snapshot" :: held 1.908s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:41 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Created reservations ['8d4ef88b-3063-4619-bb6d-01fc24abd09a', '66f93a23-db9b-4091-a3dd-fd8f9d572f89', 'cf1b10eb-35d6-410e-b2a2-d9a0ef9e3047', '9f87f0db-57b3-4725-9bae-f9095a1a4a0f'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:27:41 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Delete snapshot completed successfully.
Aug 12 16:27:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4d75ddbd-6a55-4d21-874b-c0cbaf63a631 tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Lock "cinder-612d20a4-c80a-4f23-baf4-cbd508e91ceb-delete_snapshot" released by "delete_snapshot" :: held 2.088s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:41 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ef9cdc61-7a10-45e9-97a2-f45df3ca9536" returned: 0 in 0.525s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ef9cdc61-7a10-45e9-97a2-f45df3ca9536 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Acquiring lock "cinder-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:41 devstack sudo[105158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ef9cdc61-7a10-45e9-97a2-f45df3ca9536
Aug 12 16:27:41 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Lock "cinder-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Acquiring lock "cinder-quobyte-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Lock "cinder-quobyte-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e" acquired by "delete_volume" :: waited 0.025s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:41 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b747ed-7a0b-44e6-a403-3067fa28839a]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:41 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ef9cdc61-7a10-45e9-97a2-f45df3ca9536" returned: 0 in 0.392s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:41 devstack sudo[105162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e
Aug 12 16:27:41 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] Lock "cinder-quobyte-ef9cdc61-7a10-45e9-97a2-f45df3ca9536" released by "delete_volume" :: held 0.974s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:41 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] Created reservations ['7a1e49fe-1a72-4d22-98f6-9685369867b9', 'd45f4ade-f9d4-4bfb-a8dd-48501d10e728', 'eef85abe-8312-4eb8-b6b8-401243840b2c', '7d348cce-af82-45e2-a650-c9409a0a447e'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:42 devstack sudo[105166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:27:42 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:42 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e" returned: 0 in 0.510s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:42 devstack sudo[105171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e
Aug 12 16:27:42 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:42 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.336s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:27:42 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] Deleted volume successfully.
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-df54a7c4-24b1-4e60-9049-6a583dbc6b1e tempest-VolumesServicesTestJSON-1987373377 None] Lock "cinder-ef9cdc61-7a10-45e9-97a2-f45df3ca9536-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:42 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e" returned: 0 in 0.326s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Lock "cinder-quobyte-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e" released by "delete_volume" :: held 0.924s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Created reservations ['2021603e-994b-4f7c-b2bf-fed2ee2a4182', 'c64f4ffe-9ea1-4ef5-962f-5f0f54d15856', '2c970603-94bc-465b-b442-334c6ef1525e', '34827895-2522-4866-950f-905e5421df46'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:42 devstack sudo[105175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:27:42 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:43 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.385s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:43 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:27:43 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Deleted volume successfully.
Aug 12 16:27:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-483bdd2c-2564-40cf-8f65-62fcb8f57a8c tempest-VolumesSnapshotNegativeTestJSON-539943435 None] Lock "cinder-9b2850e9-e9b5-47cc-8fd9-d4d98ba1b76e-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Flow 'volume_create_manager' (d37562e3-b1c3-4775-aedb-dd87b8421c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc052b7d-3c1e-40db-9c50-2f57a7ad2b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc052b7d-3c1e-40db-9c50-2f57a7ad2b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1974658292',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97fa354c-5483-4c50-b2af-88982af55d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5037e6d7ef8e4c79a82abe5a33694606',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=679cba59-5334-4379-adea-4fda93aab5c6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:27:46Z,use_quota=True,user_id='731938481e5546159b81661136e59731',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd6c6ea-91be-4763-8ae2-28540aa191aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffd6c6ea-91be-4763-8ae2-28540aa191aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37cd779f-3c63-494d-bc87-4ba160b01972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37cd779f-3c63-494d-bc87-4ba160b01972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '97fa354c-5483-4c50-b2af-88982af55d76', 'volume_name': 'volume-97fa354c-5483-4c50-b2af-88982af55d76', 'volume_size': 1, 'snapshot_id': '679cba59-5334-4379-adea-4fda93aab5c6'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a005478-a1bc-43c2-a93a-f14495563529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a005478-a1bc-43c2-a93a-f14495563529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2467e478-d74c-4766-b703-bd56cfa7ab98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:46 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Volume 97fa354c-5483-4c50-b2af-88982af55d76: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-97fa354c-5483-4c50-b2af-88982af55d76', 'volume_size': 1, 'snapshot_id': '679cba59-5334-4379-adea-4fda93aab5c6'}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Acquiring lock "cinder-quobyte-679cba59-5334-4379-adea-4fda93aab5c6-97fa354c-5483-4c50-b2af-88982af55d76" by "_create_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Lock "cinder-quobyte-679cba59-5334-4379-adea-4fda93aab5c6-97fa354c-5483-4c50-b2af-88982af55d76" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Creating volume 97fa354c-5483-4c50-b2af-88982af55d76 from snapshot 679cba59-5334-4379-adea-4fda93aab5c6 {{(pid=94457) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Acquiring lock "cinder-quobyte-97fa354c-5483-4c50-b2af-88982af55d76" by "_copy_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Lock "cinder-quobyte-97fa354c-5483-4c50-b2af-88982af55d76" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] snapshot: 679cba59-5334-4379-adea-4fda93aab5c6, volume: 97fa354c-5483-4c50-b2af-88982af55d76,  {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c99e02-4f86-4c02-8ce0-bfb5fbe46a27]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:46 devstack sudo[105194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6
Aug 12 16:27:46 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:46 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6" returned: 0 in 0.510s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2a5b2a-7446-4e6a-a9cb-59cc36bd1a58]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:27:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:47 devstack sudo[105199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb
Aug 12 16:27:47 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:47 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb" returned: 0 in 0.470s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 12 16:27:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Creating direct copy from snapshot {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 12 16:27:47 devstack cinder-volume[94457]: DEBUG cinder.utils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Path /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-97fa354c-5483-4c50-b2af-88982af55d76 not found in is_blk_device check {{(pid=94457) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 12 16:27:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-97fa354c-5483-4c50-b2af-88982af55d76 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:47 devstack sudo[105204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-97fa354c-5483-4c50-b2af-88982af55d76
Aug 12 16:27:47 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:56 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=34,cinder:INSERT=5,cinder:UPDATE=27,cinder:DELETE=4 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:27:56 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=24,cinder:UPDATE=34,cinder:INSERT=11,cinder:DELETE=2 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:27:57 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-97fa354c-5483-4c50-b2af-88982af55d76" returned: 0 in 9.698s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:57 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb, size 1024.00 MB, duration 9.70 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-97fa354c-5483-4c50-b2af-88982af55d76 {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:27:57 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Converted 1024.00 MB image at 105.58 MB/s
Aug 12 16:27:57 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-97fa354c-5483-4c50-b2af-88982af55d76 is being set with open permissions: ugo+rw
Aug 12 16:27:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-97fa354c-5483-4c50-b2af-88982af55d76 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:57 devstack sudo[105321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-97fa354c-5483-4c50-b2af-88982af55d76
Aug 12 16:27:57 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:57 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-97fa354c-5483-4c50-b2af-88982af55d76" returned: 0 in 0.643s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Lock "cinder-quobyte-97fa354c-5483-4c50-b2af-88982af55d76" released by "_copy_volume_from_snapshot" :: held 11.468s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Lock "cinder-quobyte-679cba59-5334-4379-adea-4fda93aab5c6-97fa354c-5483-4c50-b2af-88982af55d76" released by "_create_volume_from_snapshot" :: held 11.620s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:27:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.641s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2467e478-d74c-4766-b703-bd56cfa7ab98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97fa354c-5483-4c50-b2af-88982af55d76', 'volume_size': 1, 'snapshot_id': '679cba59-5334-4379-adea-4fda93aab5c6'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b0b38d9-2362-4419-a8d5-fa6a2fac9671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:58 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Volume volume-97fa354c-5483-4c50-b2af-88982af55d76 (97fa354c-5483-4c50-b2af-88982af55d76): created successfully
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b0b38d9-2362-4419-a8d5-fa6a2fac9671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Flow 'volume_create_manager' (d37562e3-b1c3-4775-aedb-dd87b8421c7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:27:58 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-f8782e5b-c1e7-457a-a80c-8c428d94ff92 tempest-TestStampPattern-411757869 None] Created volume successfully.
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Flow 'volume_create_manager' (17ec717f-9f23-4cef-95cc-20dc4d05b011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d77592-dad4-4965-a23e-71da11bc3943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d77592-dad4-4965-a23e-71da11bc3943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1242808703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210e97e2-16f2-4697-81ec-b66367c453da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5345cce5dcb341cdbd6c30e1657bf7e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:27:58Z,use_quota=True,user_id='9ca4dc5f515e4ff88fabd5058a566390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3327dd9-0c4f-4a0d-914c-4124ef8fd990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3327dd9-0c4f-4a0d-914c-4124ef8fd990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfff09f3-1863-4139-9bbe-577807772bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfff09f3-1863-4139-9bbe-577807772bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '210e97e2-16f2-4697-81ec-b66367c453da', 'volume_name': 'volume-210e97e2-16f2-4697-81ec-b66367c453da', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960276a5-d085-4063-bb20-c0114b44e213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960276a5-d085-4063-bb20-c0114b44e213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6504f38f-83fd-40f3-9a6b-2a15016a24db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:58 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Volume 210e97e2-16f2-4697-81ec-b66367c453da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-210e97e2-16f2-4697-81ec-b66367c453da', 'volume_size': 1}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1242808703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=210e97e2-16f2-4697-81ec-b66367c453da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5345cce5dcb341cdbd6c30e1657bf7e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:27:58Z,use_quota=True,user_id='9ca4dc5f515e4ff88fabd5058a566390',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Creating volume 210e97e2-16f2-4697-81ec-b66367c453da {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:27:58 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:27:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:58 devstack sudo[105324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da 1073741824
Aug 12 16:27:58 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:59 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da 1073741824" returned: 0 in 0.658s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:27:59 devstack sudo[105335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da
Aug 12 16:27:59 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:27:59 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root
Aug 12 16:27:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da" returned: 0 in 0.452s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:27:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:27:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:27:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6504f38f-83fd-40f3-9a6b-2a15016a24db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-210e97e2-16f2-4697-81ec-b66367c453da', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8727e81d-9d93-4135-8d53-60f41bbe6964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:27:59 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Volume volume-210e97e2-16f2-4697-81ec-b66367c453da (210e97e2-16f2-4697-81ec-b66367c453da): created successfully
Aug 12 16:27:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8727e81d-9d93-4135-8d53-60f41bbe6964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:27:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Flow 'volume_create_manager' (17ec717f-9f23-4cef-95cc-20dc4d05b011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:27:59 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-8f3763f4-f689-427a-8b76-cd8f85f27136 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Created volume successfully.
Aug 12 16:28:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fc41b030-a10e-47e4-b6b3-bd6eea3cf26b tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:28:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fc41b030-a10e-47e4-b6b3-bd6eea3cf26b tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:28:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-fc41b030-a10e-47e4-b6b3-bd6eea3cf26b tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Creating offline snapshot f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2 of volume 210e97e2-16f2-4697-81ec-b66367c453da {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:28:00 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd84aa71-aed4-4977-9481-fad269170ac3]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:28:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc41b030-a10e-47e4-b6b3-bd6eea3cf26b tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:01 devstack sudo[105360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da
Aug 12 16:28:01 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:01 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc41b030-a10e-47e4-b6b3-bd6eea3cf26b tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da" returned: 0 in 0.625s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc41b030-a10e-47e4-b6b3-bd6eea3cf26b tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:01 devstack sudo[105366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2 1G
Aug 12 16:28:01 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:02 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc41b030-a10e-47e4-b6b3-bd6eea3cf26b tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2 1G" returned: 0 in 0.573s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc41b030-a10e-47e4-b6b3-bd6eea3cf26b tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-210e97e2-16f2-4697-81ec-b66367c453da -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:02 devstack sudo[105372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-210e97e2-16f2-4697-81ec-b66367c453da -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2
Aug 12 16:28:02 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:02 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc41b030-a10e-47e4-b6b3-bd6eea3cf26b tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-210e97e2-16f2-4697-81ec-b66367c453da -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2" returned: 0 in 0.465s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:02 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-fc41b030-a10e-47e4-b6b3-bd6eea3cf26b tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2 is being set with open permissions: ugo+rw
Aug 12 16:28:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc41b030-a10e-47e4-b6b3-bd6eea3cf26b tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:02 devstack sudo[105378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2
Aug 12 16:28:02 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:03 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc41b030-a10e-47e4-b6b3-bd6eea3cf26b tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2" returned: 0 in 0.710s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc41b030-a10e-47e4-b6b3-bd6eea3cf26b tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:03 devstack sudo[105396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.info
Aug 12 16:28:03 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:04 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc41b030-a10e-47e4-b6b3-bd6eea3cf26b tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.info" returned: 0 in 0.704s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:04 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-fc41b030-a10e-47e4-b6b3-bd6eea3cf26b tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.info is being set with open permissions: ugo+rw
Aug 12 16:28:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc41b030-a10e-47e4-b6b3-bd6eea3cf26b tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:04 devstack sudo[105411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.info
Aug 12 16:28:04 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:04 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fc41b030-a10e-47e4-b6b3-bd6eea3cf26b tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.info" returned: 0 in 0.482s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fc41b030-a10e-47e4-b6b3-bd6eea3cf26b tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.715s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:28:04 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-fc41b030-a10e-47e4-b6b3-bd6eea3cf26b tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Create snapshot completed successfully
Aug 12 16:28:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Acquiring lock "cinder-f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:28:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Lock "cinder-f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:28:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Acquiring lock "cinder-quobyte-210e97e2-16f2-4697-81ec-b66367c453da" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:28:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Lock "cinder-quobyte-210e97e2-16f2-4697-81ec-b66367c453da" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:28:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Acquiring lock "cinder-quobyte-f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:28:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Lock "cinder-quobyte-f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:28:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Deleting offline snapshot f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2 of volume 210e97e2-16f2-4697-81ec-b66367c453da {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:28:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] snapshot_file for this snap is: volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:28:06 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ad93a4-408a-4ddc-bdd7-b21b74913d91]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:28:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:06 devstack sudo[105473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2
Aug 12 16:28:06 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:06 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2" returned: 0 in 0.516s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-210e97e2-16f2-4697-81ec-b66367c453da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:28:06 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2a4859-2fdf-4749-b4bd-de93b591a925]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:28:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:06 devstack sudo[105479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da
Aug 12 16:28:06 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:07 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da" returned: 0 in 0.547s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:07 devstack sudo[105487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2
Aug 12 16:28:07 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:07 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2" returned: 0 in 0.635s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:07 devstack sudo[105492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2
Aug 12 16:28:07 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:08 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da.f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2" returned: 0 in 0.455s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:08 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Lock "cinder-quobyte-f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2" released by "_delete_snapshot" :: held 2.305s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:28:08 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Lock "cinder-quobyte-210e97e2-16f2-4697-81ec-b66367c453da" released by "delete_snapshot" :: held 2.339s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:28:08 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Created reservations ['759020e7-15d9-4abe-998c-821e0dab75b3', 'b1531bdb-7097-4270-9b62-a5412b166f79', '366d86c9-4946-4c6c-aadb-79067222adf7', 'eba86189-6b28-44ff-9668-760b49cb0101'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:28:08 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Delete snapshot completed successfully.
Aug 12 16:28:08 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ee0181d7-8005-4ffa-a0ac-079ab00f7515 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Lock "cinder-f5f3b62e-d5fe-48e3-bc4f-cb356b98c7a2-delete_snapshot" released by "delete_snapshot" :: held 2.557s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:28:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Acquiring lock "cinder-210e97e2-16f2-4697-81ec-b66367c453da-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:28:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Lock "cinder-210e97e2-16f2-4697-81ec-b66367c453da-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:28:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Acquiring lock "cinder-quobyte-210e97e2-16f2-4697-81ec-b66367c453da" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:28:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Lock "cinder-quobyte-210e97e2-16f2-4697-81ec-b66367c453da" acquired by "delete_volume" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:28:09 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bd227a-fd9b-4d4f-a178-bc76c9791153]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:28:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:09 devstack sudo[105498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da
Aug 12 16:28:09 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:10 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da" returned: 0 in 0.547s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:10 devstack sudo[105505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da
Aug 12 16:28:10 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:10 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-210e97e2-16f2-4697-81ec-b66367c453da" returned: 0 in 0.311s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Lock "cinder-quobyte-210e97e2-16f2-4697-81ec-b66367c453da" released by "delete_volume" :: held 0.991s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:28:10 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Created reservations ['0b0cb13c-59a8-414e-b3ef-24a327fa1644', '724a56a0-42ce-49c2-8e62-e932eb8af370', '5e767056-218e-4172-a772-0ac46f99f20b', 'f10c15a4-5d79-4895-b6ef-8009b1b7d31c'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:28:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:28:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:28:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:28:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:28:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:28:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:10 devstack sudo[105508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:28:10 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:11 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.368s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:11 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:28:11 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Deleted volume successfully.
Aug 12 16:28:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ca85cf9e-b628-49be-aef0-32e7ddffb085 tempest-VolumeSnapshotQuotasNegativeTestJSON-1138635896 None] Lock "cinder-210e97e2-16f2-4697-81ec-b66367c453da-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Flow 'volume_create_manager' (25153376-a3bd-4f63-8d3d-37ed719559d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53005b9-6913-49ae-9c77-c55eccdce7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b53005b9-6913-49ae-9c77-c55eccdce7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-427864659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff67eb1-4929-4e30-9dc1-a0e72d2298e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f304da58db8449b8a563e7b088b5e5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:28:17Z,use_quota=True,user_id='86c64eb87982420ab5d313ac60e1265c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0597bf22-d395-4ef6-81e0-7a6469923075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0597bf22-d395-4ef6-81e0-7a6469923075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36490548-109a-404e-b3f1-c2391576a0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36490548-109a-404e-b3f1-c2391576a0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fff67eb1-4929-4e30-9dc1-a0e72d2298e6', 'volume_name': 'volume-fff67eb1-4929-4e30-9dc1-a0e72d2298e6', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1db1164-363f-408d-9f4f-32d7ccdb882f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1db1164-363f-408d-9f4f-32d7ccdb882f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f53fd9-611c-48cd-8390-b356f5440785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:17 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Volume fff67eb1-4929-4e30-9dc1-a0e72d2298e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fff67eb1-4929-4e30-9dc1-a0e72d2298e6', 'volume_size': 1}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-427864659',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fff67eb1-4929-4e30-9dc1-a0e72d2298e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f304da58db8449b8a563e7b088b5e5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:28:17Z,use_quota=True,user_id='86c64eb87982420ab5d313ac60e1265c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Creating volume fff67eb1-4929-4e30-9dc1-a0e72d2298e6 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:28:17 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:28:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fff67eb1-4929-4e30-9dc1-a0e72d2298e6 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:17 devstack sudo[105515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fff67eb1-4929-4e30-9dc1-a0e72d2298e6 1073741824
Aug 12 16:28:17 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:18 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fff67eb1-4929-4e30-9dc1-a0e72d2298e6 1073741824" returned: 0 in 0.692s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fff67eb1-4929-4e30-9dc1-a0e72d2298e6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:18 devstack sudo[105521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fff67eb1-4929-4e30-9dc1-a0e72d2298e6
Aug 12 16:28:18 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:18 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fff67eb1-4929-4e30-9dc1-a0e72d2298e6" returned: 0 in 0.338s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:28:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:28:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78f53fd9-611c-48cd-8390-b356f5440785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fff67eb1-4929-4e30-9dc1-a0e72d2298e6', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27318c47-3fae-4338-9e82-a2aeb61bae47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:18 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Volume volume-fff67eb1-4929-4e30-9dc1-a0e72d2298e6 (fff67eb1-4929-4e30-9dc1-a0e72d2298e6): created successfully
Aug 12 16:28:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27318c47-3fae-4338-9e82-a2aeb61bae47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Flow 'volume_create_manager' (25153376-a3bd-4f63-8d3d-37ed719559d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:28:18 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-457c01ae-8380-4a0d-b731-863b5d9740e1 tempest-AttachVolumeNegativeTest-157029580 None] Created volume successfully.
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Flow 'volume_create_manager' (1a984979-2958-4d06-85c9-3c9954c17771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86374d4-a0d4-48f7-9cb8-66dd67567a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a86374d4-a0d4-48f7-9cb8-66dd67567a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1961108038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec2d64c-5bab-4a56-ac35-c97d0fff1464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54820685fa744b0b3ac1e89693b3e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:28:19Z,use_quota=True,user_id='5607371583ef418697bd77b7083b48ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ebd1a6-2f64-40b4-bdbb-551d4ed35e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ebd1a6-2f64-40b4-bdbb-551d4ed35e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d512ae56-38f0-46e1-ad61-9d6881b3af32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d512ae56-38f0-46e1-ad61-9d6881b3af32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ec2d64c-5bab-4a56-ac35-c97d0fff1464', 'volume_name': 'volume-3ec2d64c-5bab-4a56-ac35-c97d0fff1464', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2880a575-e8fd-4a20-b28a-4998df5b8453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2880a575-e8fd-4a20-b28a-4998df5b8453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88983429-f2c2-4a3b-b8db-23ceee51efe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:19 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Volume 3ec2d64c-5bab-4a56-ac35-c97d0fff1464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ec2d64c-5bab-4a56-ac35-c97d0fff1464', 'volume_size': 1}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:28:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1961108038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec2d64c-5bab-4a56-ac35-c97d0fff1464,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c54820685fa744b0b3ac1e89693b3e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:28:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:28:19Z,use_quota=True,user_id='5607371583ef418697bd77b7083b48ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Creating volume 3ec2d64c-5bab-4a56-ac35-c97d0fff1464 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:28:19 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ec2d64c-5bab-4a56-ac35-c97d0fff1464 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:19 devstack sudo[105524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ec2d64c-5bab-4a56-ac35-c97d0fff1464 1073741824
Aug 12 16:28:19 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:19 devstack sudo[105529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:28:19 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:19 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.403s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 29 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:28:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>, <Thread(Rabbit-heartbeat, started daemon 134532925736384)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:28:20 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ec2d64c-5bab-4a56-ac35-c97d0fff1464 1073741824" returned: 0 in 0.833s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ec2d64c-5bab-4a56-ac35-c97d0fff1464 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:20 devstack sudo[105539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ec2d64c-5bab-4a56-ac35-c97d0fff1464
Aug 12 16:28:20 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-ebfc7e9f-a196-4058-b65d-1cbaab364dc8 req-8b5d2d12-e6dc-443a-a2de-a9c1c5a7b1aa tempest-AttachVolumeNegativeTest-157029580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:28:20 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ec2d64c-5bab-4a56-ac35-c97d0fff1464" returned: 0 in 0.414s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] <== create_volume: return (1340ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:28:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:28:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-ebfc7e9f-a196-4058-b65d-1cbaab364dc8 req-8b5d2d12-e6dc-443a-a2de-a9c1c5a7b1aa tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.123s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:28:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-ebfc7e9f-a196-4058-b65d-1cbaab364dc8 req-8b5d2d12-e6dc-443a-a2de-a9c1c5a7b1aa tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:28:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88983429-f2c2-4a3b-b8db-23ceee51efe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ec2d64c-5bab-4a56-ac35-c97d0fff1464', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024f427e-5588-4e45-a0bc-1799d6ab81da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:20 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Volume volume-3ec2d64c-5bab-4a56-ac35-c97d0fff1464 (3ec2d64c-5bab-4a56-ac35-c97d0fff1464): created successfully
Aug 12 16:28:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024f427e-5588-4e45-a0bc-1799d6ab81da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Flow 'volume_create_manager' (1a984979-2958-4d06-85c9-3c9954c17771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:28:20 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-b1ee2aeb-0ddb-4030-b545-6dad54b9133a tempest-AbsoluteLimitsTests-1759199649 None] Created volume successfully.
Aug 12 16:28:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ebfc7e9f-a196-4058-b65d-1cbaab364dc8 req-8b5d2d12-e6dc-443a-a2de-a9c1c5a7b1aa tempest-AttachVolumeNegativeTest-157029580 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-fff67eb1-4929-4e30-9dc1-a0e72d2298e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11a4c1c7-f5ff-4090-a5c8-39e6dc4e36f7', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:28:20 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-ebfc7e9f-a196-4058-b65d-1cbaab364dc8 req-8b5d2d12-e6dc-443a-a2de-a9c1c5a7b1aa tempest-AttachVolumeNegativeTest-157029580 None] attachment_update completed successfully.
Aug 12 16:28:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] Acquiring lock "cinder-3ec2d64c-5bab-4a56-ac35-c97d0fff1464-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:28:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] Lock "cinder-3ec2d64c-5bab-4a56-ac35-c97d0fff1464-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:28:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] Acquiring lock "cinder-quobyte-3ec2d64c-5bab-4a56-ac35-c97d0fff1464" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:28:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] Lock "cinder-quobyte-3ec2d64c-5bab-4a56-ac35-c97d0fff1464" acquired by "delete_volume" :: waited 0.020s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:28:21 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bcf47d-9720-4671-8b89-01e8da6843b8]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:28:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ec2d64c-5bab-4a56-ac35-c97d0fff1464 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:21 devstack sudo[105982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ec2d64c-5bab-4a56-ac35-c97d0fff1464
Aug 12 16:28:21 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:22 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ec2d64c-5bab-4a56-ac35-c97d0fff1464" returned: 0 in 0.429s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ec2d64c-5bab-4a56-ac35-c97d0fff1464 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:22 devstack sudo[105988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ec2d64c-5bab-4a56-ac35-c97d0fff1464
Aug 12 16:28:22 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:22 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ec2d64c-5bab-4a56-ac35-c97d0fff1464" returned: 0 in 0.303s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:22 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] Lock "cinder-quobyte-3ec2d64c-5bab-4a56-ac35-c97d0fff1464" released by "delete_volume" :: held 0.792s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:28:22 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] Created reservations ['16cf07e7-292d-4efe-9d40-ffb959a855e1', 'e0cd4310-cbd2-4653-bcb5-443b388460b9', 'cb48dbeb-0954-482c-a427-ac19aa316894', 'f2d16769-ff9c-449a-9664-db8501dadb0b'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:28:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:28:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:28:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:28:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:28:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:28:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:22 devstack sudo[105991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:28:22 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:22 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.314s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:22 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:28:22 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] Deleted volume successfully.
Aug 12 16:28:22 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ca4e3ca9-cc15-4f45-8aba-761565b5b02a tempest-AbsoluteLimitsTests-1759199649 None] Lock "cinder-3ec2d64c-5bab-4a56-ac35-c97d0fff1464-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Flow 'volume_create_manager' (8407ae37-1709-4c24-b6f0-d6891dec02fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5cff36c-139d-40de-87c1-78256f497da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5cff36c-139d-40de-87c1-78256f497da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-505656892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac457f3-7186-481d-bc2a-b364cabcb8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93471cb02c4041f483d2e2201c8ae953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:28:29Z,use_quota=True,user_id='d62a3cb4f1c6444396a750eb8013727d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db642e28-c2ed-4bfa-98a0-dd9634b46967),volume_type_id=db642e28-c2ed-4bfa-98a0-dd9634b46967)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2de0715-5c4d-46bf-9395-9087f78b8f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2de0715-5c4d-46bf-9395-9087f78b8f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a3701c-a91c-413e-906a-c72b35fe417f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05a3701c-a91c-413e-906a-c72b35fe417f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ac457f3-7186-481d-bc2a-b364cabcb8c5', 'volume_name': 'volume-5ac457f3-7186-481d-bc2a-b364cabcb8c5', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1466fd55-0a92-4fd6-9e34-4b345ed24ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1466fd55-0a92-4fd6-9e34-4b345ed24ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499d1fe4-375c-40e3-9180-dc43abdf6398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:29 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Volume 5ac457f3-7186-481d-bc2a-b364cabcb8c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ac457f3-7186-481d-bc2a-b364cabcb8c5', 'volume_size': 1}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-505656892',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ac457f3-7186-481d-bc2a-b364cabcb8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93471cb02c4041f483d2e2201c8ae953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:28:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:28:29Z,use_quota=True,user_id='d62a3cb4f1c6444396a750eb8013727d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db642e28-c2ed-4bfa-98a0-dd9634b46967),volume_type_id=db642e28-c2ed-4bfa-98a0-dd9634b46967)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Creating volume 5ac457f3-7186-481d-bc2a-b364cabcb8c5 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:28:29 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:28:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5ac457f3-7186-481d-bc2a-b364cabcb8c5 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:29 devstack sudo[106013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5ac457f3-7186-481d-bc2a-b364cabcb8c5 1073741824
Aug 12 16:28:29 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Flow 'volume_create_manager' (dcd7062c-6c12-44fa-8508-86d56f02d797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba35fb78-f784-4a9a-be58-9b778bcfaf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba35fb78-f784-4a9a-be58-9b778bcfaf14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1904507495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=313068fe-fc49-4dcd-b2da-598424044b39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93471cb02c4041f483d2e2201c8ae953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:28:30Z,use_quota=True,user_id='d62a3cb4f1c6444396a750eb8013727d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f8ad199-ca3e-4162-8e01-ca9c2e326379),volume_type_id=8f8ad199-ca3e-4162-8e01-ca9c2e326379)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bdbb5a-3bd9-482e-b89d-b959f5eb2ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bdbb5a-3bd9-482e-b89d-b959f5eb2ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd5f996-0a94-49e0-a52d-2fba6ad209a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd5f996-0a94-49e0-a52d-2fba6ad209a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '313068fe-fc49-4dcd-b2da-598424044b39', 'volume_name': 'volume-313068fe-fc49-4dcd-b2da-598424044b39', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78def85-1c9e-44a0-81b3-69b0a8bd18d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e78def85-1c9e-44a0-81b3-69b0a8bd18d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fdb179-c927-47a8-90e3-a02ff3bbf4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:30 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Volume 313068fe-fc49-4dcd-b2da-598424044b39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-313068fe-fc49-4dcd-b2da-598424044b39', 'volume_size': 1}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:28:30 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5ac457f3-7186-481d-bc2a-b364cabcb8c5 1073741824" returned: 0 in 0.843s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5ac457f3-7186-481d-bc2a-b364cabcb8c5 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:30 devstack sudo[106023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5ac457f3-7186-481d-bc2a-b364cabcb8c5
Aug 12 16:28:30 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:30 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5ac457f3-7186-481d-bc2a-b364cabcb8c5" returned: 0 in 0.320s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.592s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1904507495',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=313068fe-fc49-4dcd-b2da-598424044b39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93471cb02c4041f483d2e2201c8ae953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:28:30Z,use_quota=True,user_id='d62a3cb4f1c6444396a750eb8013727d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f8ad199-ca3e-4162-8e01-ca9c2e326379),volume_type_id=8f8ad199-ca3e-4162-8e01-ca9c2e326379)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Creating volume 313068fe-fc49-4dcd-b2da-598424044b39 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:28:30 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-313068fe-fc49-4dcd-b2da-598424044b39 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (499d1fe4-375c-40e3-9180-dc43abdf6398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ac457f3-7186-481d-bc2a-b364cabcb8c5', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:30 devstack sudo[106026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-313068fe-fc49-4dcd-b2da-598424044b39 1073741824
Aug 12 16:28:30 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901a8cab-f637-4bbc-997d-7711bdfa43bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:30 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Volume volume-5ac457f3-7186-481d-bc2a-b364cabcb8c5 (5ac457f3-7186-481d-bc2a-b364cabcb8c5): created successfully
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (901a8cab-f637-4bbc-997d-7711bdfa43bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Flow 'volume_create_manager' (8407ae37-1709-4c24-b6f0-d6891dec02fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:28:30 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:28:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Flow 'volume_create_manager' (6e97e4b4-b011-4945-a63c-d3af098727dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:28:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b481c3-43a9-4c07-b2fa-0d918747ab98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:31 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-b9742750-887a-4784-8263-84f7b5fc9abd tempest-TestInstancesWithCinderVolumes-1496009876 None] Created volume successfully.
Aug 12 16:28:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b481c3-43a9-4c07-b2fa-0d918747ab98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1549976262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3dc1ca1-5e60-4a00-b866-2b61aba275e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93471cb02c4041f483d2e2201c8ae953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:28:31Z,use_quota=True,user_id='d62a3cb4f1c6444396a750eb8013727d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b0b270b-224f-43af-a919-abe03f34f178),volume_type_id=1b0b270b-224f-43af-a919-abe03f34f178)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022dcffb-9710-4b27-ad56-074377593c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (022dcffb-9710-4b27-ad56-074377593c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6a68ef-ce0c-4da5-9d5a-64a3ba0aefc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:31 devstack cinder-volume[94457]: DEBUG cinder.image.glance [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Creating Keystone auth plugin from conf {{(pid=94457) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 12 16:28:31 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-313068fe-fc49-4dcd-b2da-598424044b39 1073741824" returned: 0 in 0.872s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-313068fe-fc49-4dcd-b2da-598424044b39 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:31 devstack sudo[106058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-313068fe-fc49-4dcd-b2da-598424044b39
Aug 12 16:28:31 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc6a68ef-ce0c-4da5-9d5a-64a3ba0aefc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd3dc1ca1-5e60-4a00-b866-2b61aba275e6', 'volume_name': 'volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6', 'volume_size': 1, 'image_id': '991af72c-5206-4964-aed9-d2aea5a84977', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/991af72c-5206-4964-aed9-d2aea5a84977', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--374601219', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '93471cb02c4041f483d2e2201c8ae953', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '991af72c-5206-4964-aed9-d2aea5a84977', 'created_at': datetime.datetime(2026, 8, 12, 14, 28, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 28, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991af72c-5206-4964-aed9-d2aea5a84977/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b633cbb90>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96eecb01-cf06-4a0e-840c-638d3cae0d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96eecb01-cf06-4a0e-840c-638d3cae0d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b898f1b1-de8e-43e3-b37a-f54c34f8a196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:32 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Volume d3dc1ca1-5e60-4a00-b866-2b61aba275e6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6', 'volume_size': 1, 'image_id': '991af72c-5206-4964-aed9-d2aea5a84977', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/991af72c-5206-4964-aed9-d2aea5a84977', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--374601219', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '93471cb02c4041f483d2e2201c8ae953', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '991af72c-5206-4964-aed9-d2aea5a84977', 'created_at': datetime.datetime(2026, 8, 12, 14, 28, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 28, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991af72c-5206-4964-aed9-d2aea5a84977/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b633cbb90>}
Aug 12 16:28:32 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Trying to clone d3dc1ca1-5e60-4a00-b866-2b61aba275e6 from image 991af72c-5206-4964-aed9-d2aea5a84977 at location (None, [{'url': 'file:///opt/stack/data/glance/images/991af72c-5206-4964-aed9-d2aea5a84977', 'metadata': {}}]). {{(pid=94457) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 12 16:28:32 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-313068fe-fc49-4dcd-b2da-598424044b39" returned: 0 in 0.540s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:28:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:28:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fdb179-c927-47a8-90e3-a02ff3bbf4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-313068fe-fc49-4dcd-b2da-598424044b39', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04166ad-06ff-43d0-9c50-5c8998953c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:32 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Volume volume-313068fe-fc49-4dcd-b2da-598424044b39 (313068fe-fc49-4dcd-b2da-598424044b39): created successfully
Aug 12 16:28:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d04166ad-06ff-43d0-9c50-5c8998953c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Flow 'volume_create_manager' (dcd7062c-6c12-44fa-8508-86d56f02d797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:28:32 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-0013ba54-7a24-4ca4-ac14-26ad142c3323 tempest-TestInstancesWithCinderVolumes-1496009876 None] Created volume successfully.
Aug 12 16:28:37 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_991af72c-5206-4964-aed9-d2aea5a84977_0t7y5_6kdevstack@QuobyteHD, size 20.69 MB, duration 4.94 sec {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 12 16:28:37 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Image download 20.69 MB at 4.18 MB/s
Aug 12 16:28:37 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4ab1a6-e28c-4070-b69b-e3355971d5ee]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:28:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_991af72c-5206-4964-aed9-d2aea5a84977_0t7y5_6kdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:37 devstack sudo[106099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_991af72c-5206-4964-aed9-d2aea5a84977_0t7y5_6kdevstack@QuobyteHD
Aug 12 16:28:37 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:37 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_991af72c-5206-4964-aed9-d2aea5a84977_0t7y5_6kdevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:37 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Temporary image 991af72c-5206-4964-aed9-d2aea5a84977 is fetched for user d62a3cb4f1c6444396a750eb8013727d. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 12 16:28:37 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[c530e5d7-d5fd-461c-b554-a9ae903a21c1]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:28:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_991af72c-5206-4964-aed9-d2aea5a84977_0t7y5_6kdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:37 devstack sudo[106105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_991af72c-5206-4964-aed9-d2aea5a84977_0t7y5_6kdevstack@QuobyteHD
Aug 12 16:28:37 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:38 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_991af72c-5206-4964-aed9-d2aea5a84977_0t7y5_6kdevstack@QuobyteHD" returned: 0 in 0.548s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:28:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:28:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1549976262',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3dc1ca1-5e60-4a00-b866-2b61aba275e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93471cb02c4041f483d2e2201c8ae953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:28:31Z,use_quota=True,user_id='d62a3cb4f1c6444396a750eb8013727d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b0b270b-224f-43af-a919-abe03f34f178),volume_type_id=1b0b270b-224f-43af-a919-abe03f34f178)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:28:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Creating volume d3dc1ca1-5e60-4a00-b866-2b61aba275e6 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:28:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:28:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:28:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:28:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:28:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:28:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:28:38 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:28:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:38 devstack sudo[106113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6 1073741824
Aug 12 16:28:38 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:38 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6 1073741824" returned: 0 in 0.634s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:39 devstack sudo[106119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6
Aug 12 16:28:39 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:39 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6" returned: 0 in 0.540s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:28:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:28:39 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Attempting download of 991af72c-5206-4964-aed9-d2aea5a84977 ((None, [{'url': 'file:///opt/stack/data/glance/images/991af72c-5206-4964-aed9-d2aea5a84977', 'metadata': {}}])) to volume d3dc1ca1-5e60-4a00-b866-2b61aba275e6. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 12 16:28:39 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e00b934-f863-4a90-a212-90f98516b1de]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:28:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_991af72c-5206-4964-aed9-d2aea5a84977_xz1xvhmh {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:39 devstack sudo[106123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_991af72c-5206-4964-aed9-d2aea5a84977_xz1xvhmh
Aug 12 16:28:39 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:40 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_991af72c-5206-4964-aed9-d2aea5a84977_xz1xvhmh" returned: 0 in 0.532s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_991af72c-5206-4964-aed9-d2aea5a84977_xz1xvhmh {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:40 devstack sudo[106128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_991af72c-5206-4964-aed9-d2aea5a84977_xz1xvhmh
Aug 12 16:28:40 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:40 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_991af72c-5206-4964-aed9-d2aea5a84977_xz1xvhmh" returned: 1 in 0.453s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_991af72c-5206-4964-aed9-d2aea5a84977_xz1xvhmh' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:28:40 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e237a9-42f1-4581-b335-d718a45037d3]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:28:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_991af72c-5206-4964-aed9-d2aea5a84977_0t7y5_6kdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:40 devstack sudo[106134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_991af72c-5206-4964-aed9-d2aea5a84977_0t7y5_6kdevstack@QuobyteHD
Aug 12 16:28:40 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:41 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_991af72c-5206-4964-aed9-d2aea5a84977_0t7y5_6kdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:41 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] 991af72c-5206-4964-aed9-d2aea5a84977 was qcow2, converting to qcow2 {{(pid=94457) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 12 16:28:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_991af72c-5206-4964-aed9-d2aea5a84977_0t7y5_6kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:41 devstack sudo[106151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_991af72c-5206-4964-aed9-d2aea5a84977_0t7y5_6kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6
Aug 12 16:28:41 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:43 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_991af72c-5206-4964-aed9-d2aea5a84977_0t7y5_6kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6" returned: 0 in 2.068s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_991af72c-5206-4964-aed9-d2aea5a84977_0t7y5_6kdevstack@QuobyteHD, size 112.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6 {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:28:43 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Converted 112.00 MB image at 54.10 MB/s
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:43 devstack sudo[106170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6 1G
Aug 12 16:28:43 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Flow 'volume_create_manager' (ca9ed0a9-705c-47f3-9cea-642ecf0d1675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a03258-624e-40ca-981e-43e2a59e7233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a03258-624e-40ca-981e-43e2a59e7233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1105086056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e9c28e-5d40-46e7-93de-2326ce2226b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c6408ff0724f4e84da4c4ad3612588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:28:43Z,use_quota=True,user_id='31d32ee7135b42afad33f95449b446bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6214c76a-c035-4492-97f9-c494d03c5b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6214c76a-c035-4492-97f9-c494d03c5b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b527638c-9de7-4c6f-98f9-f912e1779a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b527638c-9de7-4c6f-98f9-f912e1779a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71e9c28e-5d40-46e7-93de-2326ce2226b7', 'volume_name': 'volume-71e9c28e-5d40-46e7-93de-2326ce2226b7', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7ee643-db09-445e-928d-0280a949c039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f7ee643-db09-445e-928d-0280a949c039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6be68e-f3e7-4ec2-b54f-6b14f36debd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:43 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Volume 71e9c28e-5d40-46e7-93de-2326ce2226b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71e9c28e-5d40-46e7-93de-2326ce2226b7', 'volume_size': 1}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1105086056',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71e9c28e-5d40-46e7-93de-2326ce2226b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79c6408ff0724f4e84da4c4ad3612588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:28:43Z,use_quota=True,user_id='31d32ee7135b42afad33f95449b446bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Creating volume 71e9c28e-5d40-46e7-93de-2326ce2226b7 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:28:43 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:43 devstack sudo[106172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7 1073741824
Aug 12 16:28:43 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:43 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6 1G" returned: 0 in 0.352s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Downloaded image 991af72c-5206-4964-aed9-d2aea5a84977 ((None, [{'url': 'file:///opt/stack/data/glance/images/991af72c-5206-4964-aed9-d2aea5a84977', 'metadata': {}}])) to volume d3dc1ca1-5e60-4a00-b866-2b61aba275e6 successfully. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Temporary image 991af72c-5206-4964-aed9-d2aea5a84977 for user d62a3cb4f1c6444396a750eb8013727d is deleted. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Marking volume d3dc1ca1-5e60-4a00-b866-2b61aba275e6 as bootable. {{(pid=94457) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Copying metadata from image 991af72c-5206-4964-aed9-d2aea5a84977 to d3dc1ca1-5e60-4a00-b866-2b61aba275e6. {{(pid=94457) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Creating volume glance metadata for volume d3dc1ca1-5e60-4a00-b866-2b61aba275e6 backed by image 991af72c-5206-4964-aed9-d2aea5a84977 with: {'image_id': '991af72c-5206-4964-aed9-d2aea5a84977', 'image_name': 'tempest-scenario-img--374601219', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94457) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b898f1b1-de8e-43e3-b37a-f54c34f8a196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6', 'volume_size': 1, 'image_id': '991af72c-5206-4964-aed9-d2aea5a84977', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/991af72c-5206-4964-aed9-d2aea5a84977', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--374601219', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '93471cb02c4041f483d2e2201c8ae953', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '991af72c-5206-4964-aed9-d2aea5a84977', 'created_at': datetime.datetime(2026, 8, 12, 14, 28, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 28, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/991af72c-5206-4964-aed9-d2aea5a84977/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b633cbb90>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f45f06c-995d-4316-a01f-1d5a45fd2291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:43 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Volume volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6 (d3dc1ca1-5e60-4a00-b866-2b61aba275e6): created successfully
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f45f06c-995d-4316-a01f-1d5a45fd2291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Flow 'volume_create_manager' (6e97e4b4-b011-4945-a63c-d3af098727dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:28:43 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-87dabe32-1354-4ca8-af24-f40f59786491 tempest-TestInstancesWithCinderVolumes-1496009876 None] Created volume successfully.
Aug 12 16:28:43 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7 1073741824" returned: 0 in 0.470s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:28:43 devstack sudo[106180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7
Aug 12 16:28:43 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:28:44 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root
Aug 12 16:28:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7" returned: 0 in 0.269s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:28:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:28:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:28:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6be68e-f3e7-4ec2-b54f-6b14f36debd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71e9c28e-5d40-46e7-93de-2326ce2226b7', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53bb4212-f732-4451-9655-d5ec50a633f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:28:44 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Volume volume-71e9c28e-5d40-46e7-93de-2326ce2226b7 (71e9c28e-5d40-46e7-93de-2326ce2226b7): created successfully
Aug 12 16:28:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53bb4212-f732-4451-9655-d5ec50a633f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:28:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Flow 'volume_create_manager' (ca9ed0a9-705c-47f3-9cea-642ecf0d1675) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:28:44 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-be4178c4-f3b5-470b-93f3-9b773d1d86cb tempest-VolumesActionsTest-1051943904 None] Created volume successfully.
Aug 12 16:28:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-0f732034-00a3-47b8-8c27-acce9e2ab698 req-bf3ee6e7-5707-4ba7-8cb5-ded1a5c23a13 tempest-TestInstancesWithCinderVolumes-1496009876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:28:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-0f732034-00a3-47b8-8c27-acce9e2ab698 req-bf3ee6e7-5707-4ba7-8cb5-ded1a5c23a13 tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:28:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-0f732034-00a3-47b8-8c27-acce9e2ab698 req-bf3ee6e7-5707-4ba7-8cb5-ded1a5c23a13 tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:28:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-0f732034-00a3-47b8-8c27-acce9e2ab698 req-bf3ee6e7-5707-4ba7-8cb5-ded1a5c23a13 tempest-TestInstancesWithCinderVolumes-1496009876 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '003d138a-25b1-4ce2-9a12-da1961d915b4', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:28:47 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-0f732034-00a3-47b8-8c27-acce9e2ab698 req-bf3ee6e7-5707-4ba7-8cb5-ded1a5c23a13 tempest-TestInstancesWithCinderVolumes-1496009876 None] attachment_update completed successfully.
Aug 12 16:28:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-f30f2545-f139-419e-80ef-8a1577077d85 req-8d3ddbb1-6ff7-4c10-a876-77c6b5502508 tempest-TestStampPattern-411757869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:28:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-f30f2545-f139-419e-80ef-8a1577077d85 req-8d3ddbb1-6ff7-4c10-a876-77c6b5502508 tempest-TestStampPattern-411757869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:28:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-f30f2545-f139-419e-80ef-8a1577077d85 req-8d3ddbb1-6ff7-4c10-a876-77c6b5502508 tempest-TestStampPattern-411757869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:28:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-f30f2545-f139-419e-80ef-8a1577077d85 req-8d3ddbb1-6ff7-4c10-a876-77c6b5502508 tempest-TestStampPattern-411757869 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-97fa354c-5483-4c50-b2af-88982af55d76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cfad9b00-2392-4dae-b84e-3feade72143e', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:28:50 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-f30f2545-f139-419e-80ef-8a1577077d85 req-8d3ddbb1-6ff7-4c10-a876-77c6b5502508 tempest-TestStampPattern-411757869 None] attachment_update completed successfully.
Aug 12 16:28:53 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-1442988d-6e3e-435c-8a2c-4b1343fbcc1a req-4aa78a46-a064-45ea-b16a-bf62e4a81389 tempest-TestStampPattern-411757869 None] Terminate volume connection completed successfully.
Aug 12 16:28:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-1442988d-6e3e-435c-8a2c-4b1343fbcc1a req-4aa78a46-a064-45ea-b16a-bf62e4a81389 tempest-TestStampPattern-411757869 None] Deleting attachment cfad9b00-2392-4dae-b84e-3feade72143e. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:29:02 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bc70ee6d-ee68-473d-bfcb-91f870f63e36 tempest-VolumesActionsTest-1051943904 None] Acquiring lock "cinder-71e9c28e-5d40-46e7-93de-2326ce2226b7" by "attach_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:29:02 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bc70ee6d-ee68-473d-bfcb-91f870f63e36 tempest-VolumesActionsTest-1051943904 None] Lock "cinder-71e9c28e-5d40-46e7-93de-2326ce2226b7" acquired by "attach_volume" :: waited 0.032s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:29:02 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:UPDATE=51,cinder:SELECT=61,cinder:DELETE=7,cinder:INSERT=18 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:29:02 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=62,cinder:INSERT=13,cinder:UPDATE=55,cinder:DELETE=4 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:29:02 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-bc70ee6d-ee68-473d-bfcb-91f870f63e36 tempest-VolumesActionsTest-1051943904 None] Attaching volume 71e9c28e-5d40-46e7-93de-2326ce2226b7 to instance 5836732b-b29c-4886-b4cc-83f7c8ffb998 at mountpoint /dev/vdb on host None.
Aug 12 16:29:02 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-bc70ee6d-ee68-473d-bfcb-91f870f63e36 tempest-VolumesActionsTest-1051943904 None] Attach volume completed successfully.
Aug 12 16:29:02 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bc70ee6d-ee68-473d-bfcb-91f870f63e36 tempest-VolumesActionsTest-1051943904 None] Lock "cinder-71e9c28e-5d40-46e7-93de-2326ce2226b7" released by "attach_volume" :: held 0.131s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:29:02 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9d6082f5-ba04-4973-9d2a-7723df530c1f tempest-VolumesActionsTest-1051943904 None] Acquiring lock "cinder-71e9c28e-5d40-46e7-93de-2326ce2226b7-detach_volume" by "detach_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:29:02 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9d6082f5-ba04-4973-9d2a-7723df530c1f tempest-VolumesActionsTest-1051943904 None] Lock "cinder-71e9c28e-5d40-46e7-93de-2326ce2226b7-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:29:02 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-9d6082f5-ba04-4973-9d2a-7723df530c1f tempest-VolumesActionsTest-1051943904 None] Detaching volume 71e9c28e-5d40-46e7-93de-2326ce2226b7 from instance 5836732b-b29c-4886-b4cc-83f7c8ffb998.
Aug 12 16:29:02 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-9d6082f5-ba04-4973-9d2a-7723df530c1f tempest-VolumesActionsTest-1051943904 None] Detach volume completed successfully.
Aug 12 16:29:02 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9d6082f5-ba04-4973-9d2a-7723df530c1f tempest-VolumesActionsTest-1051943904 None] Lock "cinder-71e9c28e-5d40-46e7-93de-2326ce2226b7-detach_volume" released by "detach_volume" :: held 0.097s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:29:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] Acquiring lock "cinder-97fa354c-5483-4c50-b2af-88982af55d76-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:29:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] Lock "cinder-97fa354c-5483-4c50-b2af-88982af55d76-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:29:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] Acquiring lock "cinder-quobyte-97fa354c-5483-4c50-b2af-88982af55d76" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:29:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] Lock "cinder-quobyte-97fa354c-5483-4c50-b2af-88982af55d76" acquired by "delete_volume" :: waited 0.040s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:29:03 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[166fe01b-7e41-40e2-81d7-9622e4b6fdd8]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:29:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-97fa354c-5483-4c50-b2af-88982af55d76 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:29:03 devstack sudo[106525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-97fa354c-5483-4c50-b2af-88982af55d76
Aug 12 16:29:03 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:29:04 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root
Aug 12 16:29:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-97fa354c-5483-4c50-b2af-88982af55d76" returned: 0 in 0.997s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:29:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-97fa354c-5483-4c50-b2af-88982af55d76 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:29:04 devstack sudo[106554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-97fa354c-5483-4c50-b2af-88982af55d76
Aug 12 16:29:04 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:29:05 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root
Aug 12 16:29:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-97fa354c-5483-4c50-b2af-88982af55d76" returned: 0 in 0.640s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:29:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] Lock "cinder-quobyte-97fa354c-5483-4c50-b2af-88982af55d76" released by "delete_volume" :: held 1.739s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:29:05 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] Created reservations ['0a4fb0e5-d758-4100-98eb-58ae38a04017', 'ae6d4264-7b6c-4d84-84ba-c32c1fa5aa7c', '2d6259da-5f61-4019-b4b3-9c6982e2ff21', 'b169162b-721c-47f3-96f5-3b2c1bf88295'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:29:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:29:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:29:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:29:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:29:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:29:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:29:05 devstack sudo[106579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:29:05 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:29:05 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root
Aug 12 16:29:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.359s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:29:05 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:29:05 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] Deleted volume successfully.
Aug 12 16:29:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-14aa6716-38c7-4ccb-94f2-18af8cced2f9 tempest-TestStampPattern-411757869 None] Lock "cinder-97fa354c-5483-4c50-b2af-88982af55d76-delete_volume" released by "delete_volume" :: held 2.626s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:29:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] Acquiring lock "cinder-679cba59-5334-4379-adea-4fda93aab5c6-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:29:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] Lock "cinder-679cba59-5334-4379-adea-4fda93aab5c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:29:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] Acquiring lock "cinder-quobyte-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:29:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] Lock "cinder-quobyte-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb" acquired by "delete_snapshot" :: waited 0.040s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:29:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] Acquiring lock "cinder-quobyte-679cba59-5334-4379-adea-4fda93aab5c6" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:29:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] Lock "cinder-quobyte-679cba59-5334-4379-adea-4fda93aab5c6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:29:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] Deleting offline snapshot 679cba59-5334-4379-adea-4fda93aab5c6 of volume b51c4b73-324d-4e0a-89c3-1a02d07dd7bb {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:29:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] snapshot_file for this snap is: volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:29:06 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba079abc-cde3-4b74-a297-56d2f57fca35]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:29:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:29:06 devstack sudo[106584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6
Aug 12 16:29:06 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:29:07 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root
Aug 12 16:29:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6" returned: 0 in 0.819s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:29:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:29:07 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eaa4673-5a37-4b10-a2dd-14f42c874e1c]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:29:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:29:07 devstack sudo[106590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb
Aug 12 16:29:07 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:29:08 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root
Aug 12 16:29:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb" returned: 0 in 1.036s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:29:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:29:08 devstack sudo[106597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6
Aug 12 16:29:08 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:29:09 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root
Aug 12 16:29:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6" returned: 0 in 0.730s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:29:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:29:09 devstack sudo[106607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6
Aug 12 16:29:09 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:29:09 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root
Aug 12 16:29:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb.679cba59-5334-4379-adea-4fda93aab5c6" returned: 0 in 0.370s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:29:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] Lock "cinder-quobyte-679cba59-5334-4379-adea-4fda93aab5c6" released by "_delete_snapshot" :: held 3.152s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:29:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] Lock "cinder-quobyte-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb" released by "delete_snapshot" :: held 3.207s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:29:09 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] Created reservations ['c120f075-606b-43d1-bc29-caf04d0b6eac', 'a3f88661-5b3d-47d7-a6ff-c24511e71e73', '40239842-6e9b-42c5-87a5-8314adf7717b', 'f64434e5-1d83-40dc-8fba-82d766f81565'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:29:09 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] Delete snapshot completed successfully.
Aug 12 16:29:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5be9a30d-8418-4475-88ef-ebef461875e0 tempest-TestStampPattern-411757869 None] Lock "cinder-679cba59-5334-4379-adea-4fda93aab5c6-delete_snapshot" released by "delete_snapshot" :: held 3.471s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:29:12 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-ad4214b1-e917-4f43-981a-ce3c406b613d req-6cb35acd-2b4b-4a8f-bb0b-a9079845b95a tempest-AttachVolumeNegativeTest-157029580 None] Terminate volume connection completed successfully.
Aug 12 16:29:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ad4214b1-e917-4f43-981a-ce3c406b613d req-6cb35acd-2b4b-4a8f-bb0b-a9079845b95a tempest-AttachVolumeNegativeTest-157029580 None] Deleting attachment 11a4c1c7-f5ff-4090-a5c8-39e6dc4e36f7. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:29:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] Acquiring lock "cinder-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:29:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] Lock "cinder-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:29:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] Acquiring lock "cinder-quobyte-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:29:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] Lock "cinder-quobyte-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb" acquired by "delete_volume" :: waited 0.050s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:29:18 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[6255590d-ee59-4df1-8a04-0e15eca51901]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:29:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:29:18 devstack sudo[106732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb
Aug 12 16:29:18 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:29:18 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root
Aug 12 16:29:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb" returned: 0 in 0.565s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:29:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:29:18 devstack sudo[106761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb
Aug 12 16:29:18 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:29:19 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb" returned: 0 in 0.459s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] Lock "cinder-quobyte-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb" released by "delete_volume" :: held 1.134s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] Created reservations ['f6904b27-bf9c-4c47-8f7b-11e504dca5ed', 'a785847d-c373-49cf-a91d-5def448c7673', 'f7f920c2-23d3-49a2-a209-6b8241a83680', 'd56a4e4b-9fb2-485d-859f-568b8600f766'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:29:19 devstack sudo[106790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:29:19 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:29:19 devstack sudo[106794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:29:19 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:29:19 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.360s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:29:19 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] Deleted volume successfully.
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-588c5261-c28f-49aa-8956-89a7d263200c tempest-TestStampPattern-411757869 None] Lock "cinder-b51c4b73-324d-4e0a-89c3-1a02d07dd7bb-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:29:19 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.364s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 29 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:29:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>, <Thread(Rabbit-heartbeat, started daemon 134532925736384)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:29:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f10b694a-5049-4498-a1c4-88e077b6aa22 tempest-VolumesActionsTest-1051943904 None] Acquiring lock "cinder-71e9c28e-5d40-46e7-93de-2326ce2226b7" by "attach_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:29:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f10b694a-5049-4498-a1c4-88e077b6aa22 tempest-VolumesActionsTest-1051943904 None] Lock "cinder-71e9c28e-5d40-46e7-93de-2326ce2226b7" acquired by "attach_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:29:23 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-f10b694a-5049-4498-a1c4-88e077b6aa22 tempest-VolumesActionsTest-1051943904 None] Attaching volume 71e9c28e-5d40-46e7-93de-2326ce2226b7 to instance 1f25276f-2f9d-42dd-9b8a-8d8b5b04f8de at mountpoint /dev/vdb on host None.
Aug 12 16:29:23 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-f10b694a-5049-4498-a1c4-88e077b6aa22 tempest-VolumesActionsTest-1051943904 None] Attach volume completed successfully.
Aug 12 16:29:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f10b694a-5049-4498-a1c4-88e077b6aa22 tempest-VolumesActionsTest-1051943904 None] Lock "cinder-71e9c28e-5d40-46e7-93de-2326ce2226b7" released by "attach_volume" :: held 0.120s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:29:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b77ed10d-df49-492c-8d9c-91e172c04878 tempest-VolumesActionsTest-1051943904 None] Acquiring lock "cinder-71e9c28e-5d40-46e7-93de-2326ce2226b7-detach_volume" by "detach_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:29:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b77ed10d-df49-492c-8d9c-91e172c04878 tempest-VolumesActionsTest-1051943904 None] Lock "cinder-71e9c28e-5d40-46e7-93de-2326ce2226b7-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:29:23 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-b77ed10d-df49-492c-8d9c-91e172c04878 tempest-VolumesActionsTest-1051943904 None] Detaching volume 71e9c28e-5d40-46e7-93de-2326ce2226b7 from instance 1f25276f-2f9d-42dd-9b8a-8d8b5b04f8de.
Aug 12 16:29:23 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-b77ed10d-df49-492c-8d9c-91e172c04878 tempest-VolumesActionsTest-1051943904 None] Detach volume completed successfully.
Aug 12 16:29:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b77ed10d-df49-492c-8d9c-91e172c04878 tempest-VolumesActionsTest-1051943904 None] Lock "cinder-71e9c28e-5d40-46e7-93de-2326ce2226b7-detach_volume" released by "detach_volume" :: held 0.117s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:29:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-66dd17e9-df6c-45b1-8a7f-021c0c50e2b9 tempest-VolumesActionsTest-1051943904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:29:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-66dd17e9-df6c-45b1-8a7f-021c0c50e2b9 tempest-VolumesActionsTest-1051943904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:29:29 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9787a2-878c-4d0c-9ce0-34c0214df47a]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:29:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66dd17e9-df6c-45b1-8a7f-021c0c50e2b9 tempest-VolumesActionsTest-1051943904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:29:29 devstack sudo[106907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7
Aug 12 16:29:29 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:29:30 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root
Aug 12 16:29:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66dd17e9-df6c-45b1-8a7f-021c0c50e2b9 tempest-VolumesActionsTest-1051943904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7" returned: 0 in 0.588s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:29:30 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dd5503-944b-4ab5-b5ae-fed2574ce3d2]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:29:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66dd17e9-df6c-45b1-8a7f-021c0c50e2b9 tempest-VolumesActionsTest-1051943904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:29:30 devstack sudo[106944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7
Aug 12 16:29:30 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:29:30 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root
Aug 12 16:29:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66dd17e9-df6c-45b1-8a7f-021c0c50e2b9 tempest-VolumesActionsTest-1051943904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7" returned: 0 in 0.613s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:29:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66dd17e9-df6c-45b1-8a7f-021c0c50e2b9 tempest-VolumesActionsTest-1051943904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7 /opt/stack/data/cinder/conversion/71e9c28e-5d40-46e7-93de-2326ce2226b7.temp_image.1749a08b-1e51-4324-95e4-22eac302745cgq4zd_hu.img {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:29:31 devstack sudo[106970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7 /opt/stack/data/cinder/conversion/71e9c28e-5d40-46e7-93de-2326ce2226b7.temp_image.1749a08b-1e51-4324-95e4-22eac302745cgq4zd_hu.img
Aug 12 16:29:31 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:29:33 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=30,cinder:UPDATE=27,cinder:INSERT=8 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:29:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-c979d32f-1a34-4122-b003-abf1f2508ddc req-316a8ad2-0999-40f6-bf0a-fcf4c89599ba tempest-TestInstancesWithCinderVolumes-1496009876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:29:38 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root
Aug 12 16:29:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66dd17e9-df6c-45b1-8a7f-021c0c50e2b9 tempest-VolumesActionsTest-1051943904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7 /opt/stack/data/cinder/conversion/71e9c28e-5d40-46e7-93de-2326ce2226b7.temp_image.1749a08b-1e51-4324-95e4-22eac302745cgq4zd_hu.img" returned: 0 in 7.638s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:29:38 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1b7e96-9cea-4c09-9cfc-bec02c03b2e0]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:29:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66dd17e9-df6c-45b1-8a7f-021c0c50e2b9 tempest-VolumesActionsTest-1051943904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:29:38 devstack sudo[107024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7
Aug 12 16:29:38 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:29:39 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root
Aug 12 16:29:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-66dd17e9-df6c-45b1-8a7f-021c0c50e2b9 tempest-VolumesActionsTest-1051943904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7" returned: 0 in 0.788s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:29:39 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-66dd17e9-df6c-45b1-8a7f-021c0c50e2b9 tempest-VolumesActionsTest-1051943904 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7, size 1024.00 MB, duration 7.64 sec, destination /opt/stack/data/cinder/conversion/71e9c28e-5d40-46e7-93de-2326ce2226b7.temp_image.1749a08b-1e51-4324-95e4-22eac302745cgq4zd_hu.img {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:29:39 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-66dd17e9-df6c-45b1-8a7f-021c0c50e2b9 tempest-VolumesActionsTest-1051943904 None] Converted 1024.00 MB image at 134.05 MB/s
Aug 12 16:29:39 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-66dd17e9-df6c-45b1-8a7f-021c0c50e2b9 tempest-VolumesActionsTest-1051943904 None] 1749a08b-1e51-4324-95e4-22eac302745c was raw, no need to convert to raw {{(pid=94457) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Aug 12 16:29:45 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=1 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:29:47 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:29:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Flow 'volume_create_manager' (6d67d6f0-33b6-4c8c-b982-f46fa95abe17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:29:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c703bb-17a9-4c4a-b67c-f264b04a18a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:29:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71c703bb-17a9-4c4a-b67c-f264b04a18a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe3c5cb5-ba6a-451f-8579-2e34115a311b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='552f1424af444041b51e9f4de1be742a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:29:47Z,use_quota=True,user_id='9a8eea581c5b4f1f9aa720f79637c445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a467876d-7e08-47f2-a957-4728a2d4e734),volume_type_id=a467876d-7e08-47f2-a957-4728a2d4e734)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:29:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b7163b-febe-4ec8-82e6-b7458d4352fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:29:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8b7163b-febe-4ec8-82e6-b7458d4352fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:29:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0ead48-f5f0-40ea-8302-ffa12a5993d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:29:47 devstack cinder-volume[94457]: DEBUG cinder.image.glance [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Creating Keystone auth plugin from conf {{(pid=94457) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 12 16:29:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be0ead48-f5f0-40ea-8302-ffa12a5993d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fe3c5cb5-ba6a-451f-8579-2e34115a311b', 'volume_name': 'volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b', 'volume_size': 1, 'image_id': '3900c61d-d37f-4cf6-a1cf-3a310f1f8369', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3900c61d-d37f-4cf6-a1cf-3a310f1f8369', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44523b22ac4591a182636ca4f1930e0b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '552f1424af444041b51e9f4de1be742a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cdace23038a4401b54522f3405b667f9f7d528c8627345a124eb9e5a917b985a601af1def06c093c5b516f1402e584b06b9dd660578b4f752a796cccf8a266a', 'id': '3900c61d-d37f-4cf6-a1cf-3a310f1f8369', 'created_at': datetime.datetime(2026, 8, 12, 14, 29, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 29, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3900c61d-d37f-4cf6-a1cf-3a310f1f8369/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b633cae70>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:29:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3567246-ac31-4b6b-b1ab-965325c9551a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:29:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3567246-ac31-4b6b-b1ab-965325c9551a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:29:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e6891e-e8e2-4566-a0c2-718efaa6c3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:29:47 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Volume fe3c5cb5-ba6a-451f-8579-2e34115a311b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b', 'volume_size': 1, 'image_id': '3900c61d-d37f-4cf6-a1cf-3a310f1f8369', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3900c61d-d37f-4cf6-a1cf-3a310f1f8369', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44523b22ac4591a182636ca4f1930e0b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '552f1424af444041b51e9f4de1be742a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cdace23038a4401b54522f3405b667f9f7d528c8627345a124eb9e5a917b985a601af1def06c093c5b516f1402e584b06b9dd660578b4f752a796cccf8a266a', 'id': '3900c61d-d37f-4cf6-a1cf-3a310f1f8369', 'created_at': datetime.datetime(2026, 8, 12, 14, 29, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 29, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3900c61d-d37f-4cf6-a1cf-3a310f1f8369/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b633cae70>}
Aug 12 16:29:47 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Trying to clone fe3c5cb5-ba6a-451f-8579-2e34115a311b from image 3900c61d-d37f-4cf6-a1cf-3a310f1f8369 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3900c61d-d37f-4cf6-a1cf-3a310f1f8369', 'metadata': {}}]). {{(pid=94457) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 12 16:29:47 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 12 16:29:47 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Image download 0.00 MB at 0.00 MB/s
Aug 12 16:29:47 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dc5d3b-a941-45bf-8b8a-6bd48df7b6f2]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:29:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:29:47 devstack sudo[107059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD
Aug 12 16:29:47 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:29:48 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root
Aug 12 16:29:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:29:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:29:48 devstack sudo[107063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD
Aug 12 16:29:48 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:29:48 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root
Aug 12 16:29:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD" returned: 1 in 0.387s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:29:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:29:48 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Temporary image 3900c61d-d37f-4cf6-a1cf-3a310f1f8369 is fetched for user 9a8eea581c5b4f1f9aa720f79637c445. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 12 16:29:48 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[76772d16-e7da-4c21-9fcd-5c85f059abc7]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:29:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:29:48 devstack sudo[107068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD
Aug 12 16:29:48 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:29:48 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root
Aug 12 16:29:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:29:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:29:49 devstack sudo[107072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD
Aug 12 16:29:49 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:29:49 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root
Aug 12 16:29:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:29:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:29:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:29:58 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=35,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=2 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:29:58 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1,cinder:INSERT=1 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:29:59 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Flow 'volume_create_manager' (42bf9497-b3d9-4eb1-b3b3-740e530b874c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ac74c8-1404-4004-930b-068b7aec35bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05ac74c8-1404-4004-930b-068b7aec35bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2041294915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f304da58db8449b8a563e7b088b5e5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:00Z,use_quota=True,user_id='86c64eb87982420ab5d313ac60e1265c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151da05e-9802-4c63-97e9-8cc76192f06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151da05e-9802-4c63-97e9-8cc76192f06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36eda37-4c1b-4d0a-9dcf-9fca33009747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36eda37-4c1b-4d0a-9dcf-9fca33009747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6', 'volume_name': 'volume-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3728c7-2bd2-410b-883d-fd5607a5d7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3728c7-2bd2-410b-883d-fd5607a5d7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8913a1-f32c-4f0a-bb66-b5a19a36e7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:00 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Volume 7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6', 'volume_size': 1}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-66dd17e9-df6c-45b1-8a7f-021c0c50e2b9 tempest-VolumesActionsTest-1051943904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.806s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-66dd17e9-df6c-45b1-8a7f-021c0c50e2b9 tempest-VolumesActionsTest-1051943904 None] Uploaded volume to glance image-id: 1749a08b-1e51-4324-95e4-22eac302745c. {{(pid=94457) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-c979d32f-1a34-4122-b003-abf1f2508ddc req-316a8ad2-0999-40f6-bf0a-fcf4c89599ba tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 25.170s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-c979d32f-1a34-4122-b003-abf1f2508ddc req-316a8ad2-0999-40f6-bf0a-fcf4c89599ba tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.174s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe3c5cb5-ba6a-451f-8579-2e34115a311b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='552f1424af444041b51e9f4de1be742a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:29:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:29:47Z,use_quota=True,user_id='9a8eea581c5b4f1f9aa720f79637c445',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a467876d-7e08-47f2-a957-4728a2d4e734),volume_type_id=a467876d-7e08-47f2-a957-4728a2d4e734)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Creating volume fe3c5cb5-ba6a-451f-8579-2e34115a311b {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:30:00 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:00 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-66dd17e9-df6c-45b1-8a7f-021c0c50e2b9 tempest-VolumesActionsTest-1051943904 None] Copy volume to image completed successfully.
Aug 12 16:30:00 devstack sudo[107089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b 1073741824
Aug 12 16:30:00 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-c979d32f-1a34-4122-b003-abf1f2508ddc req-316a8ad2-0999-40f6-bf0a-fcf4c89599ba tempest-TestInstancesWithCinderVolumes-1496009876 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-5ac457f3-7186-481d-bc2a-b364cabcb8c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44380f1d-24e7-4b95-952b-5a64e2422d38', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:30:00 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-c979d32f-1a34-4122-b003-abf1f2508ddc req-316a8ad2-0999-40f6-bf0a-fcf4c89599ba tempest-TestInstancesWithCinderVolumes-1496009876 None] attachment_update completed successfully.
Aug 12 16:30:01 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b 1073741824" returned: 0 in 0.501s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:01 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b
Aug 12 16:30:01 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:01 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b" returned: 0 in 0.310s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.306s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2041294915',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f304da58db8449b8a563e7b088b5e5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:00Z,use_quota=True,user_id='86c64eb87982420ab5d313ac60e1265c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Creating volume 7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:30:01 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:01 devstack sudo[107106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6 1073741824
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Attempting download of 3900c61d-d37f-4cf6-a1cf-3a310f1f8369 ((None, [{'url': 'file:///opt/stack/data/glance/images/3900c61d-d37f-4cf6-a1cf-3a310f1f8369', 'metadata': {}}])) to volume fe3c5cb5-ba6a-451f-8579-2e34115a311b. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 12 16:30:01 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[486e4c6a-2091-4a09-ae19-6425cc92d7b6]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_qp6s85vt {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:01 devstack sudo[107108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_qp6s85vt
Aug 12 16:30:01 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:01 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_qp6s85vt" returned: 0 in 0.352s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_qp6s85vt {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:01 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6 1073741824" returned: 0 in 0.485s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:01 devstack sudo[107116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6
Aug 12 16:30:01 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:01 devstack sudo[107115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_qp6s85vt
Aug 12 16:30:01 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:02 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6" returned: 0 in 0.256s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.290s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:02 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_qp6s85vt" returned: 1 in 0.349s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_qp6s85vt' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7eca54-89f1-43f5-ae68-01fd4a71b3d5]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e4b84c-03b9-46a0-aa44-aa96d3606273]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8913a1-f32c-4f0a-bb66-b5a19a36e7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc01464-528f-41f8-854f-14de3907b87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:02 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Volume volume-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6 (7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6): created successfully
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc01464-528f-41f8-854f-14de3907b87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Flow 'volume_create_manager' (42bf9497-b3d9-4eb1-b3b3-740e530b874c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:02 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-d73c1db5-322f-45a5-aa3b-a04958307934 tempest-AttachVolumeNegativeTest-157029580 None] Created volume successfully.
Aug 12 16:30:02 devstack sudo[107122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD
Aug 12 16:30:02 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:02 devstack sudo[107123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7
Aug 12 16:30:02 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:02 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:02 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7" returned: 0 in 0.435s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:02 devstack sudo[107132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD
Aug 12 16:30:02 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d4f918-50a7-4d2f-97b2-e3330f09f01d]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:02 devstack sudo[107139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7
Aug 12 16:30:02 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:02 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD" returned: 1 in 0.358s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] 3900c61d-d37f-4cf6-a1cf-3a310f1f8369 was raw, converting to qcow2 {{(pid=94457) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 12 16:30:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:02 devstack sudo[107147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b
Aug 12 16:30:02 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:03 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7" returned: 0 in 0.454s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7 /opt/stack/data/cinder/conversion/71e9c28e-5d40-46e7-93de-2326ce2226b7.temp_image.28ffe4ca-af46-4947-b8b0-214ca499d7a3mfc4zoae.img {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:03 devstack sudo[107152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7 /opt/stack/data/cinder/conversion/71e9c28e-5d40-46e7-93de-2326ce2226b7.temp_image.28ffe4ca-af46-4947-b8b0-214ca499d7a3mfc4zoae.img
Aug 12 16:30:03 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:03 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b" returned: 0 in 0.662s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:03 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3900c61d-d37f-4cf6-a1cf-3a310f1f8369_dkauwk7vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:30:03 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Converted 0.00 MB image at 0.00 MB/s
Aug 12 16:30:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:03 devstack sudo[107173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b 1G
Aug 12 16:30:03 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-a091e41f-1d57-46b6-b329-05345fc0c92f req-8abfede0-7cfd-4763-8ded-5156c3694835 tempest-TestInstancesWithCinderVolumes-1496009876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:04 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b 1G" returned: 0 in 0.978s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:04 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Downloaded image 3900c61d-d37f-4cf6-a1cf-3a310f1f8369 ((None, [{'url': 'file:///opt/stack/data/glance/images/3900c61d-d37f-4cf6-a1cf-3a310f1f8369', 'metadata': {}}])) to volume fe3c5cb5-ba6a-451f-8579-2e34115a311b successfully. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 12 16:30:04 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Temporary image 3900c61d-d37f-4cf6-a1cf-3a310f1f8369 for user 9a8eea581c5b4f1f9aa720f79637c445 is deleted. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 12 16:30:04 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Marking volume fe3c5cb5-ba6a-451f-8579-2e34115a311b as bootable. {{(pid=94457) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 12 16:30:04 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Copying metadata from image 3900c61d-d37f-4cf6-a1cf-3a310f1f8369 to fe3c5cb5-ba6a-451f-8579-2e34115a311b. {{(pid=94457) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 12 16:30:04 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Creating volume glance metadata for volume fe3c5cb5-ba6a-451f-8579-2e34115a311b backed by image 3900c61d-d37f-4cf6-a1cf-3a310f1f8369 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '3900c61d-d37f-4cf6-a1cf-3a310f1f8369', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '44523b22ac4591a182636ca4f1930e0b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94457) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 12 16:30:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-39989182-6c06-4340-a0a5-703011e6c582 req-ed277c29-eef6-4657-880e-0b5ecc632212 tempest-AttachVolumeNegativeTest-157029580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e6891e-e8e2-4566-a0c2-718efaa6c3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b', 'volume_size': 1, 'image_id': '3900c61d-d37f-4cf6-a1cf-3a310f1f8369', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3900c61d-d37f-4cf6-a1cf-3a310f1f8369', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44523b22ac4591a182636ca4f1930e0b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '552f1424af444041b51e9f4de1be742a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cdace23038a4401b54522f3405b667f9f7d528c8627345a124eb9e5a917b985a601af1def06c093c5b516f1402e584b06b9dd660578b4f752a796cccf8a266a', 'id': '3900c61d-d37f-4cf6-a1cf-3a310f1f8369', 'created_at': datetime.datetime(2026, 8, 12, 14, 29, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 29, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3900c61d-d37f-4cf6-a1cf-3a310f1f8369/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b633cae70>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80bb7fb0-6a89-4774-b957-a9dbba1df422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:04 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Volume volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b (fe3c5cb5-ba6a-451f-8579-2e34115a311b): created successfully
Aug 12 16:30:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80bb7fb0-6a89-4774-b957-a9dbba1df422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Flow 'volume_create_manager' (6d67d6f0-33b6-4c8c-b982-f46fa95abe17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:04 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-00025368-b8a4-4096-89e6-a3adf194ae13 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Created volume successfully.
Aug 12 16:30:07 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7 /opt/stack/data/cinder/conversion/71e9c28e-5d40-46e7-93de-2326ce2226b7.temp_image.28ffe4ca-af46-4947-b8b0-214ca499d7a3mfc4zoae.img" returned: 0 in 4.693s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:07 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c391dc-56ed-4fe8-a238-a42a21cfaa4e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:07 devstack sudo[107192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7
Aug 12 16:30:07 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:08 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7" returned: 0 in 0.514s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:08 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7, size 1024.00 MB, duration 4.69 sec, destination /opt/stack/data/cinder/conversion/71e9c28e-5d40-46e7-93de-2326ce2226b7.temp_image.28ffe4ca-af46-4947-b8b0-214ca499d7a3mfc4zoae.img {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:30:08 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] Converted 1024.00 MB image at 218.15 MB/s
Aug 12 16:30:08 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] 28ffe4ca-af46-4947-b8b0-214ca499d7a3 was raw, converting to qcow2 {{(pid=94457) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Aug 12 16:30:08 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[f177990a-b5dd-4c5b-9780-f59a59866e77]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/71e9c28e-5d40-46e7-93de-2326ce2226b7.temp_image.28ffe4ca-af46-4947-b8b0-214ca499d7a3mfc4zoae.img {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:08 devstack sudo[107198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/71e9c28e-5d40-46e7-93de-2326ce2226b7.temp_image.28ffe4ca-af46-4947-b8b0-214ca499d7a3mfc4zoae.img
Aug 12 16:30:08 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:08 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/71e9c28e-5d40-46e7-93de-2326ce2226b7.temp_image.28ffe4ca-af46-4947-b8b0-214ca499d7a3mfc4zoae.img" returned: 0 in 0.319s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/71e9c28e-5d40-46e7-93de-2326ce2226b7.temp_image.28ffe4ca-af46-4947-b8b0-214ca499d7a3mfc4zoae.img {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:08 devstack sudo[107202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/71e9c28e-5d40-46e7-93de-2326ce2226b7.temp_image.28ffe4ca-af46-4947-b8b0-214ca499d7a3mfc4zoae.img
Aug 12 16:30:08 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:09 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/71e9c28e-5d40-46e7-93de-2326ce2226b7.temp_image.28ffe4ca-af46-4947-b8b0-214ca499d7a3mfc4zoae.img" returned: 1 in 0.316s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/71e9c28e-5d40-46e7-93de-2326ce2226b7.temp_image.28ffe4ca-af46-4947-b8b0-214ca499d7a3mfc4zoae.img' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:30:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/71e9c28e-5d40-46e7-93de-2326ce2226b7.temp_image.28ffe4ca-af46-4947-b8b0-214ca499d7a3mfc4zoae.img /opt/stack/data/cinder/conversion/vol_upload_vfhp9qdg {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:09 devstack sudo[107207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/71e9c28e-5d40-46e7-93de-2326ce2226b7.temp_image.28ffe4ca-af46-4947-b8b0-214ca499d7a3mfc4zoae.img /opt/stack/data/cinder/conversion/vol_upload_vfhp9qdg
Aug 12 16:30:09 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:09 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/71e9c28e-5d40-46e7-93de-2326ce2226b7.temp_image.28ffe4ca-af46-4947-b8b0-214ca499d7a3mfc4zoae.img /opt/stack/data/cinder/conversion/vol_upload_vfhp9qdg" returned: 0 in 0.251s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:09 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] Image conversion details: src /opt/stack/data/cinder/conversion/71e9c28e-5d40-46e7-93de-2326ce2226b7.temp_image.28ffe4ca-af46-4947-b8b0-214ca499d7a3mfc4zoae.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_vfhp9qdg {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:30:09 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] Converted 1024.00 MB image at 1024.00 MB/s
Aug 12 16:30:09 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c412c0d-1cdb-408a-88be-3f8861df5fe4]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vfhp9qdg {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:09 devstack sudo[107212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vfhp9qdg
Aug 12 16:30:09 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:09 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_vfhp9qdg" returned: 0 in 0.324s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.654s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] Uploaded volume to glance image-id: 28ffe4ca-af46-4947-b8b0-214ca499d7a3. {{(pid=94457) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Aug 12 16:30:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-a091e41f-1d57-46b6-b329-05345fc0c92f req-8abfede0-7cfd-4763-8ded-5156c3694835 tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.882s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-a091e41f-1d57-46b6-b329-05345fc0c92f req-8abfede0-7cfd-4763-8ded-5156c3694835 tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-39989182-6c06-4340-a0a5-703011e6c582 req-ed277c29-eef6-4657-880e-0b5ecc632212 tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.050s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:10 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c4252c36-570c-4e41-91ef-bb3350bff818 tempest-VolumesActionsTest-1051943904 None] Copy volume to image completed successfully.
Aug 12 16:30:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-39989182-6c06-4340-a0a5-703011e6c582 req-ed277c29-eef6-4657-880e-0b5ecc632212 tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-a091e41f-1d57-46b6-b329-05345fc0c92f req-8abfede0-7cfd-4763-8ded-5156c3694835 tempest-TestInstancesWithCinderVolumes-1496009876 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-313068fe-fc49-4dcd-b2da-598424044b39', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9c9f1ccd-f2a9-4436-bf66-6dd5af0df089', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:30:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-39989182-6c06-4340-a0a5-703011e6c582 req-ed277c29-eef6-4657-880e-0b5ecc632212 tempest-AttachVolumeNegativeTest-157029580 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fcede93d-bc6c-458d-b653-d3685f4dd19a', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:30:10 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-a091e41f-1d57-46b6-b329-05345fc0c92f req-8abfede0-7cfd-4763-8ded-5156c3694835 tempest-TestInstancesWithCinderVolumes-1496009876 None] attachment_update completed successfully.
Aug 12 16:30:10 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-39989182-6c06-4340-a0a5-703011e6c582 req-ed277c29-eef6-4657-880e-0b5ecc632212 tempest-AttachVolumeNegativeTest-157029580 None] attachment_update completed successfully.
Aug 12 16:30:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Acquiring lock "cinder-fe3c5cb5-ba6a-451f-8579-2e34115a311b-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Lock "cinder-fe3c5cb5-ba6a-451f-8579-2e34115a311b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Acquiring lock "cinder-quobyte-fe3c5cb5-ba6a-451f-8579-2e34115a311b" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Lock "cinder-quobyte-fe3c5cb5-ba6a-451f-8579-2e34115a311b" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:11 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8b448b-1c8c-4986-9f09-0014a2d88fd5]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:11 devstack sudo[107224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b
Aug 12 16:30:11 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:11 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b" returned: 0 in 0.463s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:11 devstack sudo[107234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b
Aug 12 16:30:11 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:12 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fe3c5cb5-ba6a-451f-8579-2e34115a311b" returned: 0 in 0.385s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Lock "cinder-quobyte-fe3c5cb5-ba6a-451f-8579-2e34115a311b" released by "delete_volume" :: held 0.896s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] Acquiring lock "cinder-71e9c28e-5d40-46e7-93de-2326ce2226b7-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:12 devstack cinder-volume[94457]: WARNING cinder.quota [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:30:12 devstack cinder-volume[94457]: WARNING cinder.quota [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] Lock "cinder-71e9c28e-5d40-46e7-93de-2326ce2226b7-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Created reservations ['2f283b46-ee69-4440-87f1-7ed0a3beef43', 'c96bbf6e-5c48-470b-82c6-aa3e4b4efb3b', 'e1ff3d0f-d566-43ba-8a89-5a7409f81192', 'c72c0df2-c1f5-4758-b3c9-4dd92d42135c'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] Acquiring lock "cinder-quobyte-71e9c28e-5d40-46e7-93de-2326ce2226b7" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] Lock "cinder-quobyte-71e9c28e-5d40-46e7-93de-2326ce2226b7" acquired by "delete_volume" :: waited 0.037s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd24030-5853-4b85-ad46-784700f74d88]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:12 devstack sudo[107239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:30:12 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:12 devstack sudo[107240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7
Aug 12 16:30:12 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:12 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.299s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:30:12 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Deleted volume successfully.
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b7d484e6-228e-4e5b-adbd-3c8fe1b6bef3 tempest-VolumeAndVolumeTypeFromImageTest-1633265233 None] Lock "cinder-fe3c5cb5-ba6a-451f-8579-2e34115a311b-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:12 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7" returned: 0 in 0.442s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:12 devstack sudo[107254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7
Aug 12 16:30:12 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:13 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-71e9c28e-5d40-46e7-93de-2326ce2226b7" returned: 0 in 0.287s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] Lock "cinder-quobyte-71e9c28e-5d40-46e7-93de-2326ce2226b7" released by "delete_volume" :: held 0.804s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:13 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] Created reservations ['c7b74311-2d86-4709-afb3-98220872d8c6', '692958fd-c196-4f66-8208-8bd050215bde', 'f38e05ed-4f29-419e-b798-78ca29d10b25', '972394dc-9d7f-4d7a-9740-1dc296094518'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:30:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:13 devstack sudo[107261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:30:13 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:13 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-348528e6-9306-410e-bcee-4d57680ea288 req-f7546dc6-3c8d-4878-89d9-aeb6027b0a42 tempest-AttachVolumeNegativeTest-157029580 None] Terminate volume connection completed successfully.
Aug 12 16:30:13 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-348528e6-9306-410e-bcee-4d57680ea288 req-f7546dc6-3c8d-4878-89d9-aeb6027b0a42 tempest-AttachVolumeNegativeTest-157029580 None] Deleting attachment fcede93d-bc6c-458d-b653-d3685f4dd19a. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:30:13 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.354s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:13 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:30:13 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] Deleted volume successfully.
Aug 12 16:30:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2c7de3cb-4b2e-4119-9a15-23b7b79ec5cf tempest-VolumesActionsTest-1051943904 None] Lock "cinder-71e9c28e-5d40-46e7-93de-2326ce2226b7-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:17 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-f4176bf4-d563-49a3-b079-83af44e92cb3 req-f87cce6b-0fa6-4fcd-8c9b-9adc5bdeeeef tempest-TestInstancesWithCinderVolumes-1496009876 None] Terminate volume connection completed successfully.
Aug 12 16:30:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-f4176bf4-d563-49a3-b079-83af44e92cb3 req-f87cce6b-0fa6-4fcd-8c9b-9adc5bdeeeef tempest-TestInstancesWithCinderVolumes-1496009876 None] Deleting attachment 44380f1d-24e7-4b95-952b-5a64e2422d38. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:30:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] Acquiring lock "cinder-5ac457f3-7186-481d-bc2a-b364cabcb8c5-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "cinder-5ac457f3-7186-481d-bc2a-b364cabcb8c5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] Acquiring lock "cinder-quobyte-5ac457f3-7186-481d-bc2a-b364cabcb8c5" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "cinder-quobyte-5ac457f3-7186-481d-bc2a-b364cabcb8c5" acquired by "delete_volume" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:18 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8ba5e8-223b-4357-a410-0022645625b9]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5ac457f3-7186-481d-bc2a-b364cabcb8c5 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:18 devstack sudo[107326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5ac457f3-7186-481d-bc2a-b364cabcb8c5
Aug 12 16:30:18 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:18 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5ac457f3-7186-481d-bc2a-b364cabcb8c5" returned: 0 in 0.467s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5ac457f3-7186-481d-bc2a-b364cabcb8c5 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:18 devstack sudo[107332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5ac457f3-7186-481d-bc2a-b364cabcb8c5
Aug 12 16:30:18 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:18 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5ac457f3-7186-481d-bc2a-b364cabcb8c5" returned: 0 in 0.477s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "cinder-quobyte-5ac457f3-7186-481d-bc2a-b364cabcb8c5" released by "delete_volume" :: held 1.012s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:19 devstack cinder-volume[94457]: WARNING cinder.quota [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1635743651-59378299 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1635743651-59378299, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:30:19 devstack cinder-volume[94457]: WARNING cinder.quota [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1635743651-59378299 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1635743651-59378299, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] Created reservations ['b53bb0c9-b12c-4943-ba33-74294772c2b4', '0be2e417-d654-4b5f-ba94-c8cf9e3790bd', '2318501f-b90e-4ea6-a715-e4ab20b71ca3', '1f6127fa-ca17-4840-a914-51fb82e3c91f'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:19 devstack sudo[107335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:30:19 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:19 devstack sudo[107337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:30:19 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:19 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.413s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:30:19 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] Deleted volume successfully.
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-743916c1-04b0-414c-9db3-ba8d8ff8262f tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "cinder-5ac457f3-7186-481d-bc2a-b364cabcb8c5-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:19 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.402s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 29 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:30:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>, <Thread(Rabbit-heartbeat, started daemon 134532925736384)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Flow 'volume_create_manager' (ec3388d2-828e-42f3-9c96-74260c856994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82aff833-51c6-4330-bbab-0a5612373fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82aff833-51c6-4330-bbab-0a5612373fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1068885965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdcbd930-8a6c-4e94-bfd7-86729031197f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b583be30d74db38e1259fcc8ca385d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:21Z,use_quota=True,user_id='74771063c72a4438ab9e8fcf8c11033f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8ee3cf-3885-400a-99ee-518efdbeaad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d8ee3cf-3885-400a-99ee-518efdbeaad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a158e2f7-265b-4e75-b46f-41475967080b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a158e2f7-265b-4e75-b46f-41475967080b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdcbd930-8a6c-4e94-bfd7-86729031197f', 'volume_name': 'volume-cdcbd930-8a6c-4e94-bfd7-86729031197f', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf7fd19a-7802-4f7f-8854-1871df3670c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf7fd19a-7802-4f7f-8854-1871df3670c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f2eb83-f0a1-4b8a-8e49-50891b4839d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:21 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Volume cdcbd930-8a6c-4e94-bfd7-86729031197f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdcbd930-8a6c-4e94-bfd7-86729031197f', 'volume_size': 1}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1068885965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdcbd930-8a6c-4e94-bfd7-86729031197f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b583be30d74db38e1259fcc8ca385d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:21Z,use_quota=True,user_id='74771063c72a4438ab9e8fcf8c11033f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Creating volume cdcbd930-8a6c-4e94-bfd7-86729031197f {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:30:21 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cdcbd930-8a6c-4e94-bfd7-86729031197f 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:21 devstack sudo[107352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cdcbd930-8a6c-4e94-bfd7-86729031197f 1073741824
Aug 12 16:30:21 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Flow 'volume_create_manager' (9af499c4-d3c8-4e98-95b8-68b92adf89dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b278b17c-4460-4514-8b89-087a61614aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b278b17c-4460-4514-8b89-087a61614aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1560915347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c3d723-8d47-4149-92dd-9f6534ee2f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b583be30d74db38e1259fcc8ca385d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:22Z,use_quota=True,user_id='74771063c72a4438ab9e8fcf8c11033f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a80a04-585e-452d-a8a2-f0702685cf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a80a04-585e-452d-a8a2-f0702685cf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37d839f-8b2a-46b8-9167-8755891cc677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37d839f-8b2a-46b8-9167-8755891cc677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7c3d723-8d47-4149-92dd-9f6534ee2f9e', 'volume_name': 'volume-c7c3d723-8d47-4149-92dd-9f6534ee2f9e', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f68e7a8-6f67-4611-aca2-abae156f6740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f68e7a8-6f67-4611-aca2-abae156f6740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fa4b07-c8a8-4726-93ff-94ce8b0f6a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:21 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Volume c7c3d723-8d47-4149-92dd-9f6534ee2f9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7c3d723-8d47-4149-92dd-9f6534ee2f9e', 'volume_size': 1}
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:21 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cdcbd930-8a6c-4e94-bfd7-86729031197f 1073741824" returned: 0 in 0.840s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cdcbd930-8a6c-4e94-bfd7-86729031197f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:22 devstack sudo[107369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cdcbd930-8a6c-4e94-bfd7-86729031197f
Aug 12 16:30:22 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Flow 'volume_create_manager' (1bd58644-0f0e-4670-a502-853a95da8c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e46ceb-38a9-4b40-a318-303eea19fd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27e46ceb-38a9-4b40-a318-303eea19fd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-835081242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b583be30d74db38e1259fcc8ca385d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:22Z,use_quota=True,user_id='74771063c72a4438ab9e8fcf8c11033f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27091382-b651-440a-b08d-83a0d4e3a5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27091382-b651-440a-b08d-83a0d4e3a5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508bfa3f-195d-4c2f-8fb3-20a8e1c9f340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:22 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (508bfa3f-195d-4c2f-8fb3-20a8e1c9f340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4', 'volume_name': 'volume-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc57effe-7779-4204-a4a3-36dc18c8aba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc57effe-7779-4204-a4a3-36dc18c8aba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842bc043-926c-4086-9ec1-e4d4b5b08faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:22 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Volume dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4', 'volume_size': 1}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cdcbd930-8a6c-4e94-bfd7-86729031197f" returned: 0 in 0.677s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.804s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1560915347',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7c3d723-8d47-4149-92dd-9f6534ee2f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b583be30d74db38e1259fcc8ca385d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:22Z,use_quota=True,user_id='74771063c72a4438ab9e8fcf8c11033f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Creating volume c7c3d723-8d47-4149-92dd-9f6534ee2f9e {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:30:22 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c7c3d723-8d47-4149-92dd-9f6534ee2f9e 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:22 devstack sudo[107406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c7c3d723-8d47-4149-92dd-9f6534ee2f9e 1073741824
Aug 12 16:30:22 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f2eb83-f0a1-4b8a-8e49-50891b4839d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdcbd930-8a6c-4e94-bfd7-86729031197f', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022ea7ca-3a0e-4989-a9b1-9486e107028b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:22 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Volume volume-cdcbd930-8a6c-4e94-bfd7-86729031197f (cdcbd930-8a6c-4e94-bfd7-86729031197f): created successfully
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022ea7ca-3a0e-4989-a9b1-9486e107028b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Flow 'volume_create_manager' (ec3388d2-828e-42f3-9c96-74260c856994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:22 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-1c611303-dbe4-4dfb-8874-7acd262cc71e tempest-CreateVolumesFromImageTest-1584230446 None] Created volume successfully.
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Flow 'volume_create_manager' (94dc5871-2939-4a49-8c62-be7e4e67f141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ebafc6-b433-420c-a1aa-5a442e70d2e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ebafc6-b433-420c-a1aa-5a442e70d2e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2084649420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a088ec12-1262-4b6e-8267-9b43f52b82e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b583be30d74db38e1259fcc8ca385d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:23Z,use_quota=True,user_id='74771063c72a4438ab9e8fcf8c11033f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7d5d07-a7db-4d3b-87eb-64c3ca20b90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7d5d07-a7db-4d3b-87eb-64c3ca20b90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0677d184-f064-4487-ace5-e81bcd04efba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0677d184-f064-4487-ace5-e81bcd04efba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a088ec12-1262-4b6e-8267-9b43f52b82e2', 'volume_name': 'volume-a088ec12-1262-4b6e-8267-9b43f52b82e2', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5fb54b5-e1f0-4736-b785-8d99daeff4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5fb54b5-e1f0-4736-b785-8d99daeff4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59ed24d-896b-48c5-bd76-9a9bd24cbc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:23 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Volume a088ec12-1262-4b6e-8267-9b43f52b82e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a088ec12-1262-4b6e-8267-9b43f52b82e2', 'volume_size': 1}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:23 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-66e268e6-12dc-4a75-b3ad-db5d033f2b09 req-4b1ce8e3-8b0b-44a6-ad3a-186bfa26dd27 tempest-TestInstancesWithCinderVolumes-1496009876 None] Terminate volume connection completed successfully.
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-66e268e6-12dc-4a75-b3ad-db5d033f2b09 req-4b1ce8e3-8b0b-44a6-ad3a-186bfa26dd27 tempest-TestInstancesWithCinderVolumes-1496009876 None] Deleting attachment 9c9f1ccd-f2a9-4436-bf66-6dd5af0df089. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:30:23 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c7c3d723-8d47-4149-92dd-9f6534ee2f9e 1073741824" returned: 0 in 0.876s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c7c3d723-8d47-4149-92dd-9f6534ee2f9e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:30:23 devstack sudo[107419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c7c3d723-8d47-4149-92dd-9f6534ee2f9e
Aug 12 16:30:23 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Flow 'volume_create_manager' (7112578e-ce64-4770-b532-aeb5d8fbd8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7e091c-1d15-41b8-aa5d-d53c5d57a6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba7e091c-1d15-41b8-aa5d-d53c5d57a6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1829197589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a221f2-5ccc-4262-9dbc-7cdc7700be70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b583be30d74db38e1259fcc8ca385d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:24Z,use_quota=True,user_id='74771063c72a4438ab9e8fcf8c11033f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71353e0e-0e2d-4027-ab94-4c866ef279bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71353e0e-0e2d-4027-ab94-4c866ef279bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781ccbb5-21ff-44f8-9c69-123e2a829f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781ccbb5-21ff-44f8-9c69-123e2a829f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8a221f2-5ccc-4262-9dbc-7cdc7700be70', 'volume_name': 'volume-c8a221f2-5ccc-4262-9dbc-7cdc7700be70', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c361a44-6907-4c73-b0e7-c52e48880c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c361a44-6907-4c73-b0e7-c52e48880c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55dd595-99d3-4625-bff5-7c756cee3ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:23 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Volume c8a221f2-5ccc-4262-9dbc-7cdc7700be70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8a221f2-5ccc-4262-9dbc-7cdc7700be70', 'volume_size': 1}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:23 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c7c3d723-8d47-4149-92dd-9f6534ee2f9e" returned: 0 in 0.295s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.249s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-835081242',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b583be30d74db38e1259fcc8ca385d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:22Z,use_quota=True,user_id='74771063c72a4438ab9e8fcf8c11033f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Creating volume dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:30:23 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11fa4b07-c8a8-4726-93ff-94ce8b0f6a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7c3d723-8d47-4149-92dd-9f6534ee2f9e', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:23 devstack sudo[107422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4 1073741824
Aug 12 16:30:23 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87054362-3684-40d2-843d-9b64621ffc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:24 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Volume volume-c7c3d723-8d47-4149-92dd-9f6534ee2f9e (c7c3d723-8d47-4149-92dd-9f6534ee2f9e): created successfully
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87054362-3684-40d2-843d-9b64621ffc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Flow 'volume_create_manager' (9af499c4-d3c8-4e98-95b8-68b92adf89dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:24 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ac6ea02c-b988-49c5-8f44-ac8e61a11357 tempest-CreateVolumesFromImageTest-1584230446 None] Created volume successfully.
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Flow 'volume_create_manager' (aa5b7301-3597-4786-8115-d42c2dd7c4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e54cf5-79bd-468d-82d1-e910db32279a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e54cf5-79bd-468d-82d1-e910db32279a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-119792164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e3ee05-f43c-4054-bfad-25c7de816673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f71070f9344a9ebe67ad0014dca473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:24Z,use_quota=True,user_id='e47d75a0a40b4615bbab980a1ac8d28c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d31e20-8c1f-441e-b8ac-af658340ecc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75d31e20-8c1f-441e-b8ac-af658340ecc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0f53ac-ad22-4569-a483-a0d010646f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0f53ac-ad22-4569-a483-a0d010646f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60e3ee05-f43c-4054-bfad-25c7de816673', 'volume_name': 'volume-60e3ee05-f43c-4054-bfad-25c7de816673', 'volume_size': 2}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5339d9-3aeb-439e-8f35-3676bad9ad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef5339d9-3aeb-439e-8f35-3676bad9ad76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20606b5e-49d5-4fea-abb6-d3c4ef1e93a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:24 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Volume 60e3ee05-f43c-4054-bfad-25c7de816673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60e3ee05-f43c-4054-bfad-25c7de816673', 'volume_size': 2}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:24 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4 1073741824" returned: 0 in 0.540s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:24 devstack sudo[107431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4
Aug 12 16:30:24 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] Acquiring lock "cinder-313068fe-fc49-4dcd-b2da-598424044b39-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "cinder-313068fe-fc49-4dcd-b2da-598424044b39-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] Acquiring lock "cinder-quobyte-313068fe-fc49-4dcd-b2da-598424044b39" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:24 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4" returned: 0 in 0.275s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.578s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2084649420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a088ec12-1262-4b6e-8267-9b43f52b82e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b583be30d74db38e1259fcc8ca385d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:23Z,use_quota=True,user_id='74771063c72a4438ab9e8fcf8c11033f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Creating volume a088ec12-1262-4b6e-8267-9b43f52b82e2 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:30:24 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a088ec12-1262-4b6e-8267-9b43f52b82e2 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "cinder-quobyte-313068fe-fc49-4dcd-b2da-598424044b39" acquired by "delete_volume" :: waited 0.039s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:24 devstack sudo[107434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a088ec12-1262-4b6e-8267-9b43f52b82e2 1073741824
Aug 12 16:30:24 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (842bc043-926c-4086-9ec1-e4d4b5b08faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f04316c-7bf8-413d-ad09-e53ae30ed0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[da95ebcb-24d2-4cd3-8fd8-d76b26643a0b]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-313068fe-fc49-4dcd-b2da-598424044b39 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:24 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Volume volume-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4 (dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4): created successfully
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f04316c-7bf8-413d-ad09-e53ae30ed0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Flow 'volume_create_manager' (1bd58644-0f0e-4670-a502-853a95da8c7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:24 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-d8aecbf9-f2f9-48bb-8fde-9f024260c3e5 tempest-CreateVolumesFromImageTest-1584230446 None] Created volume successfully.
Aug 12 16:30:25 devstack sudo[107436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-313068fe-fc49-4dcd-b2da-598424044b39
Aug 12 16:30:25 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:25 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a088ec12-1262-4b6e-8267-9b43f52b82e2 1073741824" returned: 0 in 0.589s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a088ec12-1262-4b6e-8267-9b43f52b82e2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:25 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-313068fe-fc49-4dcd-b2da-598424044b39" returned: 0 in 0.573s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-313068fe-fc49-4dcd-b2da-598424044b39 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:25 devstack sudo[107445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a088ec12-1262-4b6e-8267-9b43f52b82e2
Aug 12 16:30:25 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:25 devstack sudo[107446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-313068fe-fc49-4dcd-b2da-598424044b39
Aug 12 16:30:25 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:25 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-313068fe-fc49-4dcd-b2da-598424044b39" returned: 0 in 0.346s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "cinder-quobyte-313068fe-fc49-4dcd-b2da-598424044b39" released by "delete_volume" :: held 1.013s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:25 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a088ec12-1262-4b6e-8267-9b43f52b82e2" returned: 0 in 0.453s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.105s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1829197589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8a221f2-5ccc-4262-9dbc-7cdc7700be70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b583be30d74db38e1259fcc8ca385d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:24Z,use_quota=True,user_id='74771063c72a4438ab9e8fcf8c11033f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Creating volume c8a221f2-5ccc-4262-9dbc-7cdc7700be70 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:30:25 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c8a221f2-5ccc-4262-9dbc-7cdc7700be70 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59ed24d-896b-48c5-bd76-9a9bd24cbc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a088ec12-1262-4b6e-8267-9b43f52b82e2', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (682bea21-dd8e-40e1-91c0-8aa99ae6d160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:25 devstack cinder-volume[94457]: WARNING cinder.quota [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-423576357-518020916 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-423576357-518020916, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:30:25 devstack cinder-volume[94457]: WARNING cinder.quota [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-423576357-518020916 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-423576357-518020916, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:30:25 devstack sudo[107451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c8a221f2-5ccc-4262-9dbc-7cdc7700be70 1073741824
Aug 12 16:30:25 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:25 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Volume volume-a088ec12-1262-4b6e-8267-9b43f52b82e2 (a088ec12-1262-4b6e-8267-9b43f52b82e2): created successfully
Aug 12 16:30:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (682bea21-dd8e-40e1-91c0-8aa99ae6d160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Flow 'volume_create_manager' (94dc5871-2939-4a49-8c62-be7e4e67f141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:26 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] Created reservations ['31aa826f-08db-4a57-96f3-1593e433bf69', '7eec88bf-8db6-4123-8d6c-d1fdf0c8797c', '480619f2-8ea6-4849-965b-c1b9afafca19', '0275e3f5-972f-4d4d-a7d1-ee9c2cf7db77'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:30:26 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ceea6bf7-3ee5-4e4d-9141-2ed9fa763ac0 tempest-CreateVolumesFromImageTest-1584230446 None] Created volume successfully.
Aug 12 16:30:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:26 devstack sudo[107453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:30:26 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:26 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.416s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:26 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:30:26 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] Deleted volume successfully.
Aug 12 16:30:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a0eab4a4-373b-42e3-8c1b-24e7714a1a8a tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "cinder-313068fe-fc49-4dcd-b2da-598424044b39-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:26 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c8a221f2-5ccc-4262-9dbc-7cdc7700be70 1073741824" returned: 0 in 0.767s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c8a221f2-5ccc-4262-9dbc-7cdc7700be70 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:26 devstack sudo[107460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c8a221f2-5ccc-4262-9dbc-7cdc7700be70
Aug 12 16:30:26 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:27 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c8a221f2-5ccc-4262-9dbc-7cdc7700be70" returned: 0 in 0.451s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:30:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.736s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-119792164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60e3ee05-f43c-4054-bfad-25c7de816673,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f71070f9344a9ebe67ad0014dca473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:24Z,use_quota=True,user_id='e47d75a0a40b4615bbab980a1ac8d28c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:30:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Creating volume 60e3ee05-f43c-4054-bfad-25c7de816673 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:30:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:30:27 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:30:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-60e3ee05-f43c-4054-bfad-25c7de816673 2147483648 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:27 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55dd595-99d3-4625-bff5-7c756cee3ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8a221f2-5ccc-4262-9dbc-7cdc7700be70', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:27 devstack sudo[107469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-60e3ee05-f43c-4054-bfad-25c7de816673 2147483648
Aug 12 16:30:27 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07798c5d-dfb7-4e46-8df8-cf748870ad6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:27 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:27 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Volume volume-c8a221f2-5ccc-4262-9dbc-7cdc7700be70 (c8a221f2-5ccc-4262-9dbc-7cdc7700be70): created successfully
Aug 12 16:30:27 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07798c5d-dfb7-4e46-8df8-cf748870ad6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:27 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Flow 'volume_create_manager' (7112578e-ce64-4770-b532-aeb5d8fbd8cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:27 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c6e4959c-db69-49d3-b3a4-e6a2bdc198b2 tempest-CreateVolumesFromImageTest-1584230446 None] Created volume successfully.
Aug 12 16:30:27 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-60e3ee05-f43c-4054-bfad-25c7de816673 2147483648" returned: 0 in 0.662s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-60e3ee05-f43c-4054-bfad-25c7de816673 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:27 devstack sudo[107484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-60e3ee05-f43c-4054-bfad-25c7de816673
Aug 12 16:30:27 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:28 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-60e3ee05-f43c-4054-bfad-25c7de816673" returned: 0 in 0.353s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:28 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:30:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20606b5e-49d5-4fea-abb6-d3c4ef1e93a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60e3ee05-f43c-4054-bfad-25c7de816673', 'volume_size': 2}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22fccaf-a7c7-4a80-8e7c-a7e30863a605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "cinder-c8a221f2-5ccc-4262-9dbc-7cdc7700be70-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:28 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Volume volume-60e3ee05-f43c-4054-bfad-25c7de816673 (60e3ee05-f43c-4054-bfad-25c7de816673): created successfully
Aug 12 16:30:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22fccaf-a7c7-4a80-8e7c-a7e30863a605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Flow 'volume_create_manager' (aa5b7301-3597-4786-8115-d42c2dd7c4d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-c8a221f2-5ccc-4262-9dbc-7cdc7700be70-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:28 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-b750bc68-d252-49b8-950f-a08569655890 tempest-VolumesCloneNegativeTest-159764669 None] Created volume successfully.
Aug 12 16:30:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "cinder-quobyte-c8a221f2-5ccc-4262-9dbc-7cdc7700be70" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-quobyte-c8a221f2-5ccc-4262-9dbc-7cdc7700be70" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:28 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d80c40-f00d-4f90-9c5d-90444c984150]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c8a221f2-5ccc-4262-9dbc-7cdc7700be70 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:28 devstack sudo[107489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c8a221f2-5ccc-4262-9dbc-7cdc7700be70
Aug 12 16:30:28 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] Acquiring lock "cinder-60e3ee05-f43c-4054-bfad-25c7de816673-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] Lock "cinder-60e3ee05-f43c-4054-bfad-25c7de816673-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] Acquiring lock "cinder-quobyte-60e3ee05-f43c-4054-bfad-25c7de816673" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:29 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] Lock "cinder-quobyte-60e3ee05-f43c-4054-bfad-25c7de816673" acquired by "delete_volume" :: waited 0.033s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:29 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfe0241-c6c6-43c0-ab84-53923fb81c61]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-60e3ee05-f43c-4054-bfad-25c7de816673 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:29 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c8a221f2-5ccc-4262-9dbc-7cdc7700be70" returned: 0 in 0.690s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c8a221f2-5ccc-4262-9dbc-7cdc7700be70 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:29 devstack sudo[107502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c8a221f2-5ccc-4262-9dbc-7cdc7700be70
Aug 12 16:30:29 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:29 devstack sudo[107500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-60e3ee05-f43c-4054-bfad-25c7de816673
Aug 12 16:30:29 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:29 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c8a221f2-5ccc-4262-9dbc-7cdc7700be70" returned: 0 in 0.477s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:29 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-quobyte-c8a221f2-5ccc-4262-9dbc-7cdc7700be70" released by "delete_volume" :: held 1.235s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:29 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] Created reservations ['d126dc61-bdae-4f89-ad0f-f1753bc777fc', '8321821c-d2c3-4779-bc26-36aef7783b19', '748e74a9-bb67-485e-8f44-ecaaca1bdbd3', '5839d689-26ae-452c-87ed-e7c0b8af8f3b'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:30:29 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-60e3ee05-f43c-4054-bfad-25c7de816673" returned: 0 in 0.763s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-60e3ee05-f43c-4054-bfad-25c7de816673 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:29 devstack sudo[107526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-60e3ee05-f43c-4054-bfad-25c7de816673
Aug 12 16:30:29 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:29 devstack sudo[107528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:30:29 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:30 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.385s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:30 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:30:30 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] Deleted volume successfully.
Aug 12 16:30:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-be3d2f79-d4e5-4456-9558-4df0649a4bda tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-c8a221f2-5ccc-4262-9dbc-7cdc7700be70-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:30 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-60e3ee05-f43c-4054-bfad-25c7de816673" returned: 0 in 0.532s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] Lock "cinder-quobyte-60e3ee05-f43c-4054-bfad-25c7de816673" released by "delete_volume" :: held 1.385s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:30 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] Created reservations ['47011992-df5b-4be2-b667-3e41b1ed8a99', '1e1d7094-b14e-4f2e-a427-58de5a641ebb', 'cf38427a-bd4a-4681-ad95-f02f2d82ecc6', 'f0af18d0-c339-4b0f-92a6-a1a2710fcfc7'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:30:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:30 devstack sudo[107534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:30:30 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "cinder-a088ec12-1262-4b6e-8267-9b43f52b82e2-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-a088ec12-1262-4b6e-8267-9b43f52b82e2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "cinder-quobyte-a088ec12-1262-4b6e-8267-9b43f52b82e2" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-quobyte-a088ec12-1262-4b6e-8267-9b43f52b82e2" acquired by "delete_volume" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:30 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[42624228-9b06-49ee-9388-42095a80eca3]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a088ec12-1262-4b6e-8267-9b43f52b82e2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:31 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.467s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:31 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:30:31 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] Deleted volume successfully.
Aug 12 16:30:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-af934c68-46d9-4d84-b842-ad00da2db164 tempest-VolumesCloneNegativeTest-159764669 None] Lock "cinder-60e3ee05-f43c-4054-bfad-25c7de816673-delete_volume" released by "delete_volume" :: held 2.176s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:31 devstack sudo[107537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a088ec12-1262-4b6e-8267-9b43f52b82e2
Aug 12 16:30:31 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:31 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-cd63c1c1-2fa0-4d8f-b585-9c0199277d40 req-d22ddf7c-5ebc-46f1-9f68-506d54d76c0c tempest-TestInstancesWithCinderVolumes-1496009876 None] Terminate volume connection completed successfully.
Aug 12 16:30:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-cd63c1c1-2fa0-4d8f-b585-9c0199277d40 req-d22ddf7c-5ebc-46f1-9f68-506d54d76c0c tempest-TestInstancesWithCinderVolumes-1496009876 None] Deleting attachment 003d138a-25b1-4ce2-9a12-da1961d915b4. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:30:31 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a088ec12-1262-4b6e-8267-9b43f52b82e2" returned: 0 in 0.619s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a088ec12-1262-4b6e-8267-9b43f52b82e2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:31 devstack sudo[107550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a088ec12-1262-4b6e-8267-9b43f52b82e2
Aug 12 16:30:31 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:31 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a088ec12-1262-4b6e-8267-9b43f52b82e2" returned: 0 in 0.530s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-quobyte-a088ec12-1262-4b6e-8267-9b43f52b82e2" released by "delete_volume" :: held 1.249s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:32 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] Created reservations ['3d381a11-35f3-4674-b32c-dd657434a94d', 'a35fd161-15af-469c-985b-916e16290c53', '2fb6d3e1-e8cd-47db-93ab-b8ecde68e37b', '12ee3dcf-e655-4fde-adaa-b73a2017a989'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:30:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:32 devstack sudo[107589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:30:32 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:32 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.352s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:32 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:30:32 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] Deleted volume successfully.
Aug 12 16:30:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-03e1046e-3d0f-48db-a97e-34bb4cfabf39 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-a088ec12-1262-4b6e-8267-9b43f52b82e2-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "cinder-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "cinder-quobyte-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-quobyte-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4" acquired by "delete_volume" :: waited 0.034s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:33 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f8f8e6-6822-4718-8b5b-30951285f890]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:33 devstack sudo[107624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4
Aug 12 16:30:33 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] Acquiring lock "cinder-d3dc1ca1-5e60-4a00-b866-2b61aba275e6-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "cinder-d3dc1ca1-5e60-4a00-b866-2b61aba275e6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] Acquiring lock "cinder-quobyte-d3dc1ca1-5e60-4a00-b866-2b61aba275e6" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "cinder-quobyte-d3dc1ca1-5e60-4a00-b866-2b61aba275e6" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:33 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f965b4-5a5e-47ee-8e5c-0c3b216c1d24]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:33 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:33 devstack sudo[107639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6
Aug 12 16:30:33 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4" returned: 0 in 0.564s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:33 devstack sudo[107645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4
Aug 12 16:30:33 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:34 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4" returned: 0 in 0.385s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-quobyte-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4" released by "delete_volume" :: held 1.020s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:34 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6" returned: 0 in 0.623s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:34 devstack sudo[107652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6
Aug 12 16:30:34 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] Created reservations ['333b8708-c7ce-4f91-884e-ac9e4aee4b6c', '09fff201-2cc5-4210-ac78-7d081eb26610', 'a200e6e4-b5b6-44e3-a98d-6649699bd52a', '2c6f227a-bacf-43bc-80b5-1358677a4817'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:34 devstack sudo[107654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:30:34 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:34 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d3dc1ca1-5e60-4a00-b866-2b61aba275e6" returned: 0 in 0.332s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "cinder-quobyte-d3dc1ca1-5e60-4a00-b866-2b61aba275e6" released by "delete_volume" :: held 1.032s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:34 devstack cinder-volume[94457]: WARNING cinder.quota [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-949722287-1700092776 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-949722287-1700092776, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:30:34 devstack cinder-volume[94457]: WARNING cinder.quota [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-949722287-1700092776 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-949722287-1700092776, it is now deprecated. Please use the default quota class for default quota.
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] Created reservations ['d047991e-6875-4661-aff4-07ebf46ff7d0', '3d617e7c-8831-442e-9d55-b9506806dafa', '2113d9a0-b684-4c42-9f3d-4b20bd930558', 'e714a8e6-0543-4085-aa69-975be9fba0a9'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:34 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.505s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:34 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:30:34 devstack sudo[107660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:30:34 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:34 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] Deleted volume successfully.
Aug 12 16:30:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f253fb0e-e92b-4033-b912-00f14e086d0f tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-dfdbc5a1-2bef-4ff9-b827-9f17dfa84be4-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:35 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.450s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:35 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:30:35 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] Deleted volume successfully.
Aug 12 16:30:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bba2ceb1-740b-4eb2-95fc-ff0fc5c2f731 tempest-TestInstancesWithCinderVolumes-1496009876 None] Lock "cinder-d3dc1ca1-5e60-4a00-b866-2b61aba275e6-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "cinder-c7c3d723-8d47-4149-92dd-9f6534ee2f9e-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-c7c3d723-8d47-4149-92dd-9f6534ee2f9e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "cinder-quobyte-c7c3d723-8d47-4149-92dd-9f6534ee2f9e" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-quobyte-c7c3d723-8d47-4149-92dd-9f6534ee2f9e" acquired by "delete_volume" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:35 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffec4968-95b1-4732-9dbd-0538477e58c6]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c7c3d723-8d47-4149-92dd-9f6534ee2f9e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:35 devstack sudo[107663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c7c3d723-8d47-4149-92dd-9f6534ee2f9e
Aug 12 16:30:35 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:36 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c7c3d723-8d47-4149-92dd-9f6534ee2f9e" returned: 0 in 0.544s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c7c3d723-8d47-4149-92dd-9f6534ee2f9e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:36 devstack sudo[107669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c7c3d723-8d47-4149-92dd-9f6534ee2f9e
Aug 12 16:30:36 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:36 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c7c3d723-8d47-4149-92dd-9f6534ee2f9e" returned: 0 in 0.552s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-quobyte-c7c3d723-8d47-4149-92dd-9f6534ee2f9e" released by "delete_volume" :: held 1.158s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:36 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] Created reservations ['9576ef78-6adf-444e-ba2f-093770d88e07', '6ad42f11-ac88-4617-8253-9eef7795f98c', 'eb861ebd-d99a-41a6-b64b-e990aa198355', '6bb9666a-e1f5-4aef-bcc3-9f6aa6609f0e'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:30:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:37 devstack sudo[107672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:30:37 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:37 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.495s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:37 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:30:37 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] Deleted volume successfully.
Aug 12 16:30:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b1c5b3d8-31b0-4100-b164-7cb9703bd321 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-c7c3d723-8d47-4149-92dd-9f6534ee2f9e-delete_volume" released by "delete_volume" :: held 2.046s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "cinder-cdcbd930-8a6c-4e94-bfd7-86729031197f-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-cdcbd930-8a6c-4e94-bfd7-86729031197f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "cinder-quobyte-cdcbd930-8a6c-4e94-bfd7-86729031197f" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-quobyte-cdcbd930-8a6c-4e94-bfd7-86729031197f" acquired by "delete_volume" :: waited 0.025s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:38 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfef895-77d6-4b8e-b0bd-510a0d3ccb86]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cdcbd930-8a6c-4e94-bfd7-86729031197f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:38 devstack sudo[107678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cdcbd930-8a6c-4e94-bfd7-86729031197f
Aug 12 16:30:38 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:38 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cdcbd930-8a6c-4e94-bfd7-86729031197f" returned: 0 in 0.465s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cdcbd930-8a6c-4e94-bfd7-86729031197f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:38 devstack sudo[107683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cdcbd930-8a6c-4e94-bfd7-86729031197f
Aug 12 16:30:38 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:38 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cdcbd930-8a6c-4e94-bfd7-86729031197f" returned: 0 in 0.266s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-quobyte-cdcbd930-8a6c-4e94-bfd7-86729031197f" released by "delete_volume" :: held 0.809s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:38 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] Created reservations ['fe6d410e-ce4f-4392-a922-7ebfb32830a1', '0a7cdcd4-7538-4bbb-8314-9b0ceef72dd5', '0bb628c3-3be8-4ae7-a77e-31dd6013e42e', 'a6065e08-b3fb-4678-b903-7f98406c5b1f'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:30:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:39 devstack sudo[107686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:30:39 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:39 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.428s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:39 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:30:39 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] Deleted volume successfully.
Aug 12 16:30:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-88259c03-0fb2-4277-ac2f-e7a54047a984 tempest-CreateVolumesFromImageTest-1584230446 None] Lock "cinder-cdcbd930-8a6c-4e94-bfd7-86729031197f-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Flow 'volume_create_manager' (90a5f2f0-0e24-416a-aff1-4ec87a7ccf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc50b13-95b5-49d8-bd6c-0566294c604d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc50b13-95b5-49d8-bd6c-0566294c604d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-131116330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4471d167-873f-4fb0-b316-285f7ba2bf4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7073b366fdba40f6b9c33835e1d9aaeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:49Z,use_quota=True,user_id='2f1426cae6a5413d99ba85733daf2e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4747fd-acc4-49da-b1ad-d9efd54f40f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4747fd-acc4-49da-b1ad-d9efd54f40f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c62bdc-da42-47d0-a04a-062fa47c8637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c62bdc-da42-47d0-a04a-062fa47c8637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4471d167-873f-4fb0-b316-285f7ba2bf4b', 'volume_name': 'volume-4471d167-873f-4fb0-b316-285f7ba2bf4b', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1da6e0-9094-4c3d-95fa-7eb350b6d7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc1da6e0-9094-4c3d-95fa-7eb350b6d7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f5e163-b3a2-4ea7-9a32-c4f60ff3c6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:49 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Volume 4471d167-873f-4fb0-b316-285f7ba2bf4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4471d167-873f-4fb0-b316-285f7ba2bf4b', 'volume_size': 1}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-131116330',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4471d167-873f-4fb0-b316-285f7ba2bf4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7073b366fdba40f6b9c33835e1d9aaeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:49Z,use_quota=True,user_id='2f1426cae6a5413d99ba85733daf2e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Creating volume 4471d167-873f-4fb0-b316-285f7ba2bf4b {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:30:49 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:30:49 devstack sudo[107721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b 1073741824
Aug 12 16:30:49 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Flow 'volume_create_manager' (66a631e3-748f-4041-86ca-2acf9c3be74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc97f60f-9588-46f3-98fe-ebee6a94a4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc97f60f-9588-46f3-98fe-ebee6a94a4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bc5009-bd6a-46ac-9f25-6eda3f28950c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2251a178fca44ed8a0c0ec9c7406e91e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:49Z,use_quota=True,user_id='fa4ee56a73e5431ca7e9ae2073d84f30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2fcba4-aec5-4829-9380-c0ebf1ed2e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2fcba4-aec5-4829-9380-c0ebf1ed2e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c653922-553d-4d18-9417-0a151937965f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.image.glance [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Creating Keystone auth plugin from conf {{(pid=94457) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c653922-553d-4d18-9417-0a151937965f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e1bc5009-bd6a-46ac-9f25-6eda3f28950c', 'volume_name': 'volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c', 'volume_size': 1, 'image_id': 'b5fb59f0-07fd-4c2e-a091-8d4ab293a078', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5fb59f0-07fd-4c2e-a091-8d4ab293a078', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56c1652dc9069b8371c2e1c06c951a99', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2251a178fca44ed8a0c0ec9c7406e91e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9e3ad4cb1cb1fb9e12809e1863088c8412a4d11bbd00593c2f698e70fe2ddc3852eada5c382f7ffa474b984accb810fc45e339e1d69078a5c70b0b1e7a32e5b3', 'id': 'b5fb59f0-07fd-4c2e-a091-8d4ab293a078', 'created_at': datetime.datetime(2026, 8, 12, 14, 30, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 30, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5fb59f0-07fd-4c2e-a091-8d4ab293a078/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b633decf0>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a031d0ad-e72a-43de-8e82-481e54b59759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a031d0ad-e72a-43de-8e82-481e54b59759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68dc2e57-e335-417b-9cdd-127e2be09b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:49 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Volume e1bc5009-bd6a-46ac-9f25-6eda3f28950c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c', 'volume_size': 1, 'image_id': 'b5fb59f0-07fd-4c2e-a091-8d4ab293a078', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5fb59f0-07fd-4c2e-a091-8d4ab293a078', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56c1652dc9069b8371c2e1c06c951a99', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2251a178fca44ed8a0c0ec9c7406e91e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9e3ad4cb1cb1fb9e12809e1863088c8412a4d11bbd00593c2f698e70fe2ddc3852eada5c382f7ffa474b984accb810fc45e339e1d69078a5c70b0b1e7a32e5b3', 'id': 'b5fb59f0-07fd-4c2e-a091-8d4ab293a078', 'created_at': datetime.datetime(2026, 8, 12, 14, 30, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 30, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5fb59f0-07fd-4c2e-a091-8d4ab293a078/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b633decf0>}
Aug 12 16:30:49 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Trying to clone e1bc5009-bd6a-46ac-9f25-6eda3f28950c from image b5fb59f0-07fd-4c2e-a091-8d4ab293a078 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b5fb59f0-07fd-4c2e-a091-8d4ab293a078', 'metadata': {}}]). {{(pid=94457) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 12 16:30:50 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 12 16:30:50 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Image download 0.00 MB at 0.00 MB/s
Aug 12 16:30:50 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b 1073741824" returned: 0 in 0.562s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:50 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecf7a10-89f3-454e-aa33-50c69b06f4b0]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:50 devstack sudo[107730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b
Aug 12 16:30:50 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:50 devstack sudo[107729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD
Aug 12 16:30:50 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:50 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b" returned: 0 in 0.341s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:30:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f5e163-b3a2-4ea7-9a32-c4f60ff3c6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4471d167-873f-4fb0-b316-285f7ba2bf4b', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aff10f1-8e0b-4790-8308-075457678747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:50 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Volume volume-4471d167-873f-4fb0-b316-285f7ba2bf4b (4471d167-873f-4fb0-b316-285f7ba2bf4b): created successfully
Aug 12 16:30:50 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4aff10f1-8e0b-4790-8308-075457678747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Flow 'volume_create_manager' (90a5f2f0-0e24-416a-aff1-4ec87a7ccf1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:50 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-b09c69a6-6c64-4279-b7ee-96728a678f41 tempest-VolumesSnapshotTestJSON-656818206 None] Created volume successfully.
Aug 12 16:30:50 devstack sudo[107736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD
Aug 12 16:30:50 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:50 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD" returned: 1 in 0.333s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:30:50 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Temporary image b5fb59f0-07fd-4c2e-a091-8d4ab293a078 is fetched for user fa4ee56a73e5431ca7e9ae2073d84f30. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 12 16:30:50 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[173ffaff-9e18-4f50-865d-54afc8bccf80]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:51 devstack sudo[107741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD
Aug 12 16:30:51 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:51 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:51 devstack sudo[107746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD
Aug 12 16:30:51 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2acb171e-e049-4ba1-8a2c-9522f571b1dc tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2acb171e-e049-4ba1-8a2c-9522f571b1dc tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-2acb171e-e049-4ba1-8a2c-9522f571b1dc tempest-VolumesSnapshotTestJSON-656818206 None] Creating offline snapshot 9a66b50e-ef61-4c1d-83d9-19000ead3527 of volume 4471d167-873f-4fb0-b316-285f7ba2bf4b {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:30:51 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff2183e-1e4c-4985-be40-4e633887cff8]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2acb171e-e049-4ba1-8a2c-9522f571b1dc tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:51 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD" returned: 1 in 0.368s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:30:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:51 devstack sudo[107751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b
Aug 12 16:30:51 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:52 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2acb171e-e049-4ba1-8a2c-9522f571b1dc tempest-VolumesSnapshotTestJSON-656818206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b" returned: 0 in 0.384s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2acb171e-e049-4ba1-8a2c-9522f571b1dc tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:52 devstack sudo[107756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527 1G
Aug 12 16:30:52 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:52 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2acb171e-e049-4ba1-8a2c-9522f571b1dc tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527 1G" returned: 0 in 0.433s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2acb171e-e049-4ba1-8a2c-9522f571b1dc tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4471d167-873f-4fb0-b316-285f7ba2bf4b -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:52 devstack sudo[107762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4471d167-873f-4fb0-b316-285f7ba2bf4b -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527
Aug 12 16:30:52 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:52 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2acb171e-e049-4ba1-8a2c-9522f571b1dc tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4471d167-873f-4fb0-b316-285f7ba2bf4b -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527" returned: 0 in 0.286s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:52 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-2acb171e-e049-4ba1-8a2c-9522f571b1dc tempest-VolumesSnapshotTestJSON-656818206 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527 is being set with open permissions: ugo+rw
Aug 12 16:30:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2acb171e-e049-4ba1-8a2c-9522f571b1dc tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:52 devstack sudo[107767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527
Aug 12 16:30:52 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:53 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2acb171e-e049-4ba1-8a2c-9522f571b1dc tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527" returned: 0 in 0.256s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2acb171e-e049-4ba1-8a2c-9522f571b1dc tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:53 devstack sudo[107770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.info
Aug 12 16:30:53 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:53 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2acb171e-e049-4ba1-8a2c-9522f571b1dc tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.info" returned: 0 in 0.384s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:53 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-2acb171e-e049-4ba1-8a2c-9522f571b1dc tempest-VolumesSnapshotTestJSON-656818206 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.info is being set with open permissions: ugo+rw
Aug 12 16:30:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2acb171e-e049-4ba1-8a2c-9522f571b1dc tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:53 devstack sudo[107773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.info
Aug 12 16:30:53 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:53 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2acb171e-e049-4ba1-8a2c-9522f571b1dc tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.info" returned: 0 in 0.306s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2acb171e-e049-4ba1-8a2c-9522f571b1dc tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.162s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.088s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:53 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1bc5009-bd6a-46ac-9f25-6eda3f28950c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2251a178fca44ed8a0c0ec9c7406e91e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:49Z,use_quota=True,user_id='fa4ee56a73e5431ca7e9ae2073d84f30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:30:53 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Creating volume e1bc5009-bd6a-46ac-9f25-6eda3f28950c {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:30:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:53 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:53 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:53 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:30:53 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:30:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:53 devstack sudo[107776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c 1073741824
Aug 12 16:30:53 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:53 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-2acb171e-e049-4ba1-8a2c-9522f571b1dc tempest-VolumesSnapshotTestJSON-656818206 None] Create snapshot completed successfully
Aug 12 16:30:54 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c 1073741824" returned: 0 in 0.618s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:54 devstack sudo[107782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c
Aug 12 16:30:54 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:54 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c" returned: 0 in 0.292s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:54 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:30:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:54 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Attempting download of b5fb59f0-07fd-4c2e-a091-8d4ab293a078 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5fb59f0-07fd-4c2e-a091-8d4ab293a078', 'metadata': {}}])) to volume e1bc5009-bd6a-46ac-9f25-6eda3f28950c. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 12 16:30:54 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d14d38-20fa-4d99-b793-768f1168fc22]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_d_z84_ys {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:55 devstack sudo[107785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_d_z84_ys
Aug 12 16:30:55 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-9a66b50e-ef61-4c1d-83d9-19000ead3527-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-9a66b50e-ef61-4c1d-83d9-19000ead3527-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-quobyte-4471d167-873f-4fb0-b316-285f7ba2bf4b" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-4471d167-873f-4fb0-b316-285f7ba2bf4b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-quobyte-9a66b50e-ef61-4c1d-83d9-19000ead3527" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-9a66b50e-ef61-4c1d-83d9-19000ead3527" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] Deleting offline snapshot 9a66b50e-ef61-4c1d-83d9-19000ead3527 of volume 4471d167-873f-4fb0-b316-285f7ba2bf4b {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] snapshot_file for this snap is: volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[40faaac5-a485-4210-a43e-f97a6edac8c4]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:55 devstack sudo[107787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527
Aug 12 16:30:55 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:55 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_d_z84_ys" returned: 0 in 0.477s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_d_z84_ys {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:55 devstack sudo[107791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_d_z84_ys
Aug 12 16:30:55 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:55 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527" returned: 0 in 0.467s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4471d167-873f-4fb0-b316-285f7ba2bf4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d453c567-d051-42b4-9a53-f0b4a0b0897d]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:55 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_d_z84_ys" returned: 1 in 0.429s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_d_z84_ys' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc69ad2-983c-4722-a573-2971ec8de8f1]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:55 devstack sudo[107796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b
Aug 12 16:30:55 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:55 devstack sudo[107799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD
Aug 12 16:30:55 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:56 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:56 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b" returned: 0 in 0.470s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:56 devstack sudo[107808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527
Aug 12 16:30:56 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:56 devstack sudo[107807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD
Aug 12 16:30:56 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:56 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:30:56 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] b5fb59f0-07fd-4c2e-a091-8d4ab293a078 was raw, converting to qcow2 {{(pid=94457) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 12 16:30:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:56 devstack sudo[107818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c
Aug 12 16:30:56 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:56 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527" returned: 0 in 0.406s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:56 devstack sudo[107820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527
Aug 12 16:30:56 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:56 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b.9a66b50e-ef61-4c1d-83d9-19000ead3527" returned: 0 in 0.339s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-9a66b50e-ef61-4c1d-83d9-19000ead3527" released by "_delete_snapshot" :: held 1.820s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-4471d167-873f-4fb0-b316-285f7ba2bf4b" released by "delete_snapshot" :: held 1.851s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:57 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:57 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] Created reservations ['7104cf8e-9097-4a25-bdd8-32f62cbba1a3', 'efd135ca-84b6-4589-a1bd-65809c38f641', 'cd6d5c9f-6ee7-4880-80a1-f5d16519ee47', '50733800-c2d4-408a-aac0-25dfbd354d14'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:30:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c" returned: 0 in 0.548s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:57 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b5fb59f0-07fd-4c2e-a091-8d4ab293a078_ljq4_u5wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:30:57 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Converted 0.00 MB image at 0.00 MB/s
Aug 12 16:30:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:57 devstack sudo[107837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c 1G
Aug 12 16:30:57 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:57 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] Delete snapshot completed successfully.
Aug 12 16:30:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f707e089-4739-4149-b10a-2ef993ee91a7 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-9a66b50e-ef61-4c1d-83d9-19000ead3527-delete_snapshot" released by "delete_snapshot" :: held 2.141s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:57 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c 1G" returned: 0 in 0.516s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:57 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Downloaded image b5fb59f0-07fd-4c2e-a091-8d4ab293a078 ((None, [{'url': 'file:///opt/stack/data/glance/images/b5fb59f0-07fd-4c2e-a091-8d4ab293a078', 'metadata': {}}])) to volume e1bc5009-bd6a-46ac-9f25-6eda3f28950c successfully. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 12 16:30:57 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Temporary image b5fb59f0-07fd-4c2e-a091-8d4ab293a078 for user fa4ee56a73e5431ca7e9ae2073d84f30 is deleted. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 12 16:30:57 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Marking volume e1bc5009-bd6a-46ac-9f25-6eda3f28950c as bootable. {{(pid=94457) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 12 16:30:57 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Copying metadata from image b5fb59f0-07fd-4c2e-a091-8d4ab293a078 to e1bc5009-bd6a-46ac-9f25-6eda3f28950c. {{(pid=94457) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 12 16:30:57 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Creating volume glance metadata for volume e1bc5009-bd6a-46ac-9f25-6eda3f28950c backed by image b5fb59f0-07fd-4c2e-a091-8d4ab293a078 with: {'image_id': 'b5fb59f0-07fd-4c2e-a091-8d4ab293a078', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '56c1652dc9069b8371c2e1c06c951a99', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94457) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 12 16:30:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68dc2e57-e335-417b-9cdd-127e2be09b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c', 'volume_size': 1, 'image_id': 'b5fb59f0-07fd-4c2e-a091-8d4ab293a078', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b5fb59f0-07fd-4c2e-a091-8d4ab293a078', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '56c1652dc9069b8371c2e1c06c951a99', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2251a178fca44ed8a0c0ec9c7406e91e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9e3ad4cb1cb1fb9e12809e1863088c8412a4d11bbd00593c2f698e70fe2ddc3852eada5c382f7ffa474b984accb810fc45e339e1d69078a5c70b0b1e7a32e5b3', 'id': 'b5fb59f0-07fd-4c2e-a091-8d4ab293a078', 'created_at': datetime.datetime(2026, 8, 12, 14, 30, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 30, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b5fb59f0-07fd-4c2e-a091-8d4ab293a078/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b633decf0>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cee77fa-0203-4a97-98b8-a0924d99b98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:57 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Volume volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c (e1bc5009-bd6a-46ac-9f25-6eda3f28950c): created successfully
Aug 12 16:30:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cee77fa-0203-4a97-98b8-a0924d99b98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Flow 'volume_create_manager' (66a631e3-748f-4041-86ca-2acf9c3be74e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:57 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-0ebc904a-235d-4c9e-a192-d37f92a557c3 tempest-VolumeImageDependencyTests-1749216766 None] Created volume successfully.
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Flow 'volume_create_manager' (9dadfcaf-ff72-4a97-bd2e-9b13f5d80310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1da6aa5-56de-415f-832d-625503ca2bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1da6aa5-56de-415f-832d-625503ca2bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1835708352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f304da58db8449b8a563e7b088b5e5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:58Z,use_quota=True,user_id='86c64eb87982420ab5d313ac60e1265c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314f0dff-cd83-4f8f-ad24-d88fae3331ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (314f0dff-cd83-4f8f-ad24-d88fae3331ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5afd51b-d293-4f9e-a039-ce18f95dfd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5afd51b-d293-4f9e-a039-ce18f95dfd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5', 'volume_name': 'volume-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d81eae2-d961-4f6e-a5e7-3b4a365e2f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d81eae2-d961-4f6e-a5e7-3b4a365e2f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e03d26-030d-4487-9d99-e8c1bb21c9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:58 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Volume 1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5', 'volume_size': 1}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1835708352',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f304da58db8449b8a563e7b088b5e5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:58Z,use_quota=True,user_id='86c64eb87982420ab5d313ac60e1265c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Creating volume 1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:30:58 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] Acquiring lock "cinder-e1bc5009-bd6a-46ac-9f25-6eda3f28950c-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:58 devstack sudo[107844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5 1073741824
Aug 12 16:30:58 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] Lock "cinder-e1bc5009-bd6a-46ac-9f25-6eda3f28950c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Flow 'volume_create_manager' (23f60f44-7395-4ad5-bcfc-81e60f09b8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01511d18-ac5f-4db1-a907-71e1266cc27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01511d18-ac5f-4db1-a907-71e1266cc27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1163240100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23aef795-2f71-4fa3-b2f5-15baa988b653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7073b366fdba40f6b9c33835e1d9aaeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:58Z,use_quota=True,user_id='2f1426cae6a5413d99ba85733daf2e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c11823-be61-4575-8e44-2968ec96b7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c11823-be61-4575-8e44-2968ec96b7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afa08260-ad60-40ec-bf39-349f6e958d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afa08260-ad60-40ec-bf39-349f6e958d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23aef795-2f71-4fa3-b2f5-15baa988b653', 'volume_name': 'volume-23aef795-2f71-4fa3-b2f5-15baa988b653', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4efd434d-c530-4e30-a846-a1ead479a4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4efd434d-c530-4e30-a846-a1ead479a4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505ddecb-1cb4-445c-aa93-276dc1fa7b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:58 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Volume 23aef795-2f71-4fa3-b2f5-15baa988b653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23aef795-2f71-4fa3-b2f5-15baa988b653', 'volume_size': 1}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] Acquiring lock "cinder-quobyte-e1bc5009-bd6a-46ac-9f25-6eda3f28950c" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] Lock "cinder-quobyte-e1bc5009-bd6a-46ac-9f25-6eda3f28950c" acquired by "delete_volume" :: waited 0.019s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[79eeeaa1-b188-44ca-bf3a-2e685393f773]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:58 devstack sudo[107846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c
Aug 12 16:30:58 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:58 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5 1073741824" returned: 0 in 0.517s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=135,cinder:UPDATE=136,cinder:INSERT=37,cinder:DELETE=10 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=122,cinder:UPDATE=136,cinder:DELETE=12,cinder:INSERT=40 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:58 devstack sudo[107854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5
Aug 12 16:30:58 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:58 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c" returned: 0 in 0.433s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:58 devstack sudo[107857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c
Aug 12 16:30:58 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:59 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5" returned: 0 in 0.340s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.748s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:30:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1163240100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23aef795-2f71-4fa3-b2f5-15baa988b653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7073b366fdba40f6b9c33835e1d9aaeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:30:58Z,use_quota=True,user_id='2f1426cae6a5413d99ba85733daf2e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Creating volume 23aef795-2f71-4fa3-b2f5-15baa988b653 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:59 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:30:59 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e1bc5009-bd6a-46ac-9f25-6eda3f28950c" returned: 0 in 0.307s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:59 devstack sudo[107861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653 1073741824
Aug 12 16:30:59 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e03d26-030d-4487-9d99-e8c1bb21c9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954959e5-f74e-4aac-aa45-7400be09fe1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] Lock "cinder-quobyte-e1bc5009-bd6a-46ac-9f25-6eda3f28950c" released by "delete_volume" :: held 0.803s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:59 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Volume volume-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5 (1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5): created successfully
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954959e5-f74e-4aac-aa45-7400be09fe1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Flow 'volume_create_manager' (9dadfcaf-ff72-4a97-bd2e-9b13f5d80310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:30:59 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-db398603-5fb0-4bfd-a452-d76803786bed tempest-AttachVolumeNegativeTest-157029580 None] Created volume successfully.
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] Created reservations ['dd51967d-21dd-41ef-9e91-4299705193f1', '568b6c3a-733f-4e85-8193-54cd8693e6ba', '3398b8a4-23db-4179-9927-a0cdcd8adf7c', 'b8b214b4-2b01-42e9-bb39-43c8f241ead4'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:59 devstack sudo[107863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:30:59 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:30:59 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653 1073741824" returned: 0 in 0.532s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:59 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.278s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:30:59 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] Deleted volume successfully.
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c6d745c8-f0ac-4af8-877b-e191d0a72639 tempest-VolumeImageDependencyTests-1749216766 None] Lock "cinder-e1bc5009-bd6a-46ac-9f25-6eda3f28950c-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:30:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:30:59 devstack sudo[107869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653
Aug 12 16:30:59 devstack sudo[107869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:00 devstack sudo[107869]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653" returned: 0 in 0.252s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:31:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (505ddecb-1cb4-445c-aa93-276dc1fa7b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23aef795-2f71-4fa3-b2f5-15baa988b653', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aaf975c-b162-4a15-9d7b-dfa600614dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:00 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Volume volume-23aef795-2f71-4fa3-b2f5-15baa988b653 (23aef795-2f71-4fa3-b2f5-15baa988b653): created successfully
Aug 12 16:31:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3aaf975c-b162-4a15-9d7b-dfa600614dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Flow 'volume_create_manager' (23f60f44-7395-4ad5-bcfc-81e60f09b8b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:31:00 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c541f90c-76a6-4b03-8aa5-5dbf76b7905a tempest-VolumesSnapshotTestJSON-656818206 None] Created volume successfully.
Aug 12 16:31:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-db4430c9-0563-4426-9114-dee178e47d79 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-db4430c9-0563-4426-9114-dee178e47d79 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-db4430c9-0563-4426-9114-dee178e47d79 tempest-VolumesSnapshotTestJSON-656818206 None] Creating offline snapshot ba359314-dee0-4c4a-8d6b-ac18b1b358c9 of volume 23aef795-2f71-4fa3-b2f5-15baa988b653 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:31:00 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60b9895-73bc-455c-a381-55d402219af8]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-db4430c9-0563-4426-9114-dee178e47d79 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:00 devstack sudo[107873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653
Aug 12 16:31:00 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:00 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-db4430c9-0563-4426-9114-dee178e47d79 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653" returned: 0 in 0.460s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-db4430c9-0563-4426-9114-dee178e47d79 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:01 devstack sudo[107881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9 1G
Aug 12 16:31:01 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-39f4d13f-965a-4532-b81e-cb36283b2b50 req-3f4058d7-92d5-4f4e-a633-62f401e55cef tempest-AttachVolumeNegativeTest-157029580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:01 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-db4430c9-0563-4426-9114-dee178e47d79 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9 1G" returned: 0 in 0.555s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-db4430c9-0563-4426-9114-dee178e47d79 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23aef795-2f71-4fa3-b2f5-15baa988b653 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:01 devstack sudo[107896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23aef795-2f71-4fa3-b2f5-15baa988b653 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9
Aug 12 16:31:01 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:01 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-db4430c9-0563-4426-9114-dee178e47d79 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23aef795-2f71-4fa3-b2f5-15baa988b653 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9" returned: 0 in 0.370s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:01 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-db4430c9-0563-4426-9114-dee178e47d79 tempest-VolumesSnapshotTestJSON-656818206 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9 is being set with open permissions: ugo+rw
Aug 12 16:31:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-db4430c9-0563-4426-9114-dee178e47d79 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:01 devstack sudo[107901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9
Aug 12 16:31:01 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:02 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-db4430c9-0563-4426-9114-dee178e47d79 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9" returned: 0 in 0.278s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-db4430c9-0563-4426-9114-dee178e47d79 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:02 devstack sudo[107904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.info
Aug 12 16:31:02 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:02 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-db4430c9-0563-4426-9114-dee178e47d79 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.info" returned: 0 in 0.314s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:02 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-db4430c9-0563-4426-9114-dee178e47d79 tempest-VolumesSnapshotTestJSON-656818206 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.info is being set with open permissions: ugo+rw
Aug 12 16:31:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-db4430c9-0563-4426-9114-dee178e47d79 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:02 devstack sudo[107907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.info
Aug 12 16:31:02 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:02 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-db4430c9-0563-4426-9114-dee178e47d79 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.info" returned: 0 in 0.263s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-db4430c9-0563-4426-9114-dee178e47d79 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.351s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-39f4d13f-965a-4532-b81e-cb36283b2b50 req-3f4058d7-92d5-4f4e-a633-62f401e55cef tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.325s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-39f4d13f-965a-4532-b81e-cb36283b2b50 req-3f4058d7-92d5-4f4e-a633-62f401e55cef tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:02 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-db4430c9-0563-4426-9114-dee178e47d79 tempest-VolumesSnapshotTestJSON-656818206 None] Create snapshot completed successfully
Aug 12 16:31:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-39f4d13f-965a-4532-b81e-cb36283b2b50 req-3f4058d7-92d5-4f4e-a633-62f401e55cef tempest-AttachVolumeNegativeTest-157029580 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '60e6715d-8133-4b95-8c0a-13ffe7595121', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:31:02 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-39f4d13f-965a-4532-b81e-cb36283b2b50 req-3f4058d7-92d5-4f4e-a633-62f401e55cef tempest-AttachVolumeNegativeTest-157029580 None] attachment_update completed successfully.
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Flow 'volume_create_manager' (7bff3995-300d-4de4-b3e4-2f2d8d65dfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991c6c16-886d-406c-9efd-02af34a7bbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991c6c16-886d-406c-9efd-02af34a7bbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-113497413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df7314dc-9a4c-4519-971e-99b5d5ffafb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7073b366fdba40f6b9c33835e1d9aaeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:31:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ba359314-dee0-4c4a-8d6b-ac18b1b358c9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:31:04Z,use_quota=True,user_id='2f1426cae6a5413d99ba85733daf2e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd25271-b696-4182-a574-fcfc889a08e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dd25271-b696-4182-a574-fcfc889a08e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77de8938-d680-4e7b-a17b-36e3fef35387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77de8938-d680-4e7b-a17b-36e3fef35387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'df7314dc-9a4c-4519-971e-99b5d5ffafb7', 'volume_name': 'volume-df7314dc-9a4c-4519-971e-99b5d5ffafb7', 'volume_size': 2, 'snapshot_id': 'ba359314-dee0-4c4a-8d6b-ac18b1b358c9'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0045d7bd-a64e-458d-9a77-03bbe6cc23b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0045d7bd-a64e-458d-9a77-03bbe6cc23b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61d71c4-295b-4ec2-9e76-dd82cb4e2500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:04 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Volume df7314dc-9a4c-4519-971e-99b5d5ffafb7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-df7314dc-9a4c-4519-971e-99b5d5ffafb7', 'volume_size': 2, 'snapshot_id': 'ba359314-dee0-4c4a-8d6b-ac18b1b358c9'}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-quobyte-ba359314-dee0-4c4a-8d6b-ac18b1b358c9-df7314dc-9a4c-4519-971e-99b5d5ffafb7" by "_create_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-ba359314-dee0-4c4a-8d6b-ac18b1b358c9-df7314dc-9a4c-4519-971e-99b5d5ffafb7" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Creating volume df7314dc-9a4c-4519-971e-99b5d5ffafb7 from snapshot ba359314-dee0-4c4a-8d6b-ac18b1b358c9 {{(pid=94457) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-quobyte-df7314dc-9a4c-4519-971e-99b5d5ffafb7" by "_copy_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-df7314dc-9a4c-4519-971e-99b5d5ffafb7" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] snapshot: ba359314-dee0-4c4a-8d6b-ac18b1b358c9, volume: df7314dc-9a4c-4519-971e-99b5d5ffafb7,  {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d52ca3d-6470-4dc7-800c-5195bd3bbc5f]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:04 devstack sudo[108296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9
Aug 12 16:31:04 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:05 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9" returned: 0 in 0.626s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23aef795-2f71-4fa3-b2f5-15baa988b653(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:31:05 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf766db-5118-4c72-bf24-a084c83b0207]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:05 devstack sudo[108302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653
Aug 12 16:31:05 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:05 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-6a900baa-4eaa-4dc0-9d4e-f460e4300009 req-e46b99e9-85f2-45df-808d-5a27ea10fdf8 tempest-AttachVolumeNegativeTest-157029580 None] Terminate volume connection completed successfully.
Aug 12 16:31:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-6a900baa-4eaa-4dc0-9d4e-f460e4300009 req-e46b99e9-85f2-45df-808d-5a27ea10fdf8 tempest-AttachVolumeNegativeTest-157029580 None] Deleting attachment 60e6715d-8133-4b95-8c0a-13ffe7595121. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:31:05 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653" returned: 0 in 0.499s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653 {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 12 16:31:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Creating direct copy from snapshot {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 12 16:31:05 devstack cinder-volume[94457]: DEBUG cinder.utils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Path /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-df7314dc-9a4c-4519-971e-99b5d5ffafb7 not found in is_blk_device check {{(pid=94457) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 12 16:31:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-df7314dc-9a4c-4519-971e-99b5d5ffafb7 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:05 devstack sudo[108336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-df7314dc-9a4c-4519-971e-99b5d5ffafb7
Aug 12 16:31:05 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:12 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-df7314dc-9a4c-4519-971e-99b5d5ffafb7" returned: 0 in 6.580s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:12 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653, size 1024.00 MB, duration 6.58 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-df7314dc-9a4c-4519-971e-99b5d5ffafb7 {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:31:12 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Converted 1024.00 MB image at 155.60 MB/s
Aug 12 16:31:12 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-df7314dc-9a4c-4519-971e-99b5d5ffafb7 is being set with open permissions: ugo+rw
Aug 12 16:31:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-df7314dc-9a4c-4519-971e-99b5d5ffafb7 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:12 devstack sudo[108377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-df7314dc-9a4c-4519-971e-99b5d5ffafb7
Aug 12 16:31:12 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:12 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-df7314dc-9a4c-4519-971e-99b5d5ffafb7" returned: 0 in 0.302s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-df7314dc-9a4c-4519-971e-99b5d5ffafb7" released by "_copy_volume_from_snapshot" :: held 8.130s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-ba359314-dee0-4c4a-8d6b-ac18b1b358c9-df7314dc-9a4c-4519-971e-99b5d5ffafb7" released by "_create_volume_from_snapshot" :: held 8.225s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.250s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61d71c4-295b-4ec2-9e76-dd82cb4e2500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df7314dc-9a4c-4519-971e-99b5d5ffafb7', 'volume_size': 2, 'snapshot_id': 'ba359314-dee0-4c4a-8d6b-ac18b1b358c9'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27db583-6b04-4274-af93-a62748846d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:12 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Volume volume-df7314dc-9a4c-4519-971e-99b5d5ffafb7 (df7314dc-9a4c-4519-971e-99b5d5ffafb7): created successfully
Aug 12 16:31:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27db583-6b04-4274-af93-a62748846d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Flow 'volume_create_manager' (7bff3995-300d-4de4-b3e4-2f2d8d65dfff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:31:12 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-7bfb0eb1-179a-4d8d-ac20-53d39213f521 tempest-VolumesSnapshotTestJSON-656818206 None] Created volume successfully.
Aug 12 16:31:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-df7314dc-9a4c-4519-971e-99b5d5ffafb7-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-df7314dc-9a4c-4519-971e-99b5d5ffafb7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-quobyte-df7314dc-9a4c-4519-971e-99b5d5ffafb7" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-df7314dc-9a4c-4519-971e-99b5d5ffafb7" acquired by "delete_volume" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:13 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d97ce77-e847-4a3e-93fc-776fa4e401ba]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-df7314dc-9a4c-4519-971e-99b5d5ffafb7 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:13 devstack sudo[108380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-df7314dc-9a4c-4519-971e-99b5d5ffafb7
Aug 12 16:31:13 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] Acquiring lock "cinder-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] Lock "cinder-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] Acquiring lock "cinder-quobyte-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] Lock "cinder-quobyte-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5" acquired by "delete_volume" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[703497fd-6eb1-4ccb-954c-4ec53a2aa169]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:14 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-df7314dc-9a4c-4519-971e-99b5d5ffafb7" returned: 0 in 0.492s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-df7314dc-9a4c-4519-971e-99b5d5ffafb7 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:14 devstack sudo[108386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-df7314dc-9a4c-4519-971e-99b5d5ffafb7
Aug 12 16:31:14 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:14 devstack sudo[108385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5
Aug 12 16:31:14 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:14 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-df7314dc-9a4c-4519-971e-99b5d5ffafb7" returned: 0 in 0.285s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-df7314dc-9a4c-4519-971e-99b5d5ffafb7" released by "delete_volume" :: held 0.838s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] Created reservations ['26826acc-76f2-4237-bea0-75ea9742ec10', 'fe413301-c904-4033-99d3-e6b4d2e102c1', '02c54998-b999-4383-9d7c-ba3f48215a00', '4099a06d-3ab9-4619-8b4b-fc11f0250ba6'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:31:14 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5" returned: 0 in 0.399s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:14 devstack sudo[108393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5
Aug 12 16:31:14 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:14 devstack sudo[108395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:31:14 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-ba359314-dee0-4c4a-8d6b-ac18b1b358c9-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-ba359314-dee0-4c4a-8d6b-ac18b1b358c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-quobyte-23aef795-2f71-4fa3-b2f5-15baa988b653" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-23aef795-2f71-4fa3-b2f5-15baa988b653" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-quobyte-ba359314-dee0-4c4a-8d6b-ac18b1b358c9" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:14 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-ba359314-dee0-4c4a-8d6b-ac18b1b358c9" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] Deleting offline snapshot ba359314-dee0-4c4a-8d6b-ac18b1b358c9 of volume 23aef795-2f71-4fa3-b2f5-15baa988b653 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] snapshot_file for this snap is: volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5" returned: 0 in 0.384s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fa72f3-0830-4abf-9073-78c5c18b8feb]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] Lock "cinder-quobyte-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5" released by "delete_volume" :: held 0.864s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:15 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.366s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:31:15 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] Deleted volume successfully.
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4852f58b-f70e-4bc0-80e8-14d7bec468f6 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-df7314dc-9a4c-4519-971e-99b5d5ffafb7-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] Created reservations ['5466e5e4-3bba-4e6f-8d2d-f2cad60cfcdd', '73f1b7d4-c6ed-490a-8d1f-f5b6bb9cf43c', '9d1b6fea-0f24-4537-9bb2-f95a8fbce895', '70f88123-c8a1-436f-b607-cb0d55853cf5'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:31:15 devstack sudo[108399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9
Aug 12 16:31:15 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:15 devstack sudo[108401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:31:15 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] Acquiring lock "cinder-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] Lock "cinder-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] Acquiring lock "cinder-quobyte-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:15 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9" returned: 0 in 0.504s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23aef795-2f71-4fa3-b2f5-15baa988b653(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] Lock "cinder-quobyte-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6" acquired by "delete_volume" :: waited 0.034s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad690a1f-db19-4eea-8962-ca4382093ced]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:15 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.342s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[c686a7c8-33bc-41c5-8e0a-2db034b7ee2d]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:15 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] Deleted volume successfully.
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-adc6beb1-953e-422b-9b3f-6dd0ae666989 tempest-AttachVolumeNegativeTest-157029580 None] Lock "cinder-1cf8d579-2bf7-4c18-964a-1c0a9e3b1be5-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:15 devstack sudo[108408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653
Aug 12 16:31:15 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:15 devstack sudo[108409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6
Aug 12 16:31:15 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:15 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6" returned: 0 in 0.400s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:16 devstack sudo[108419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6
Aug 12 16:31:16 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:16 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653" returned: 0 in 0.686s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:16 devstack sudo[108423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9
Aug 12 16:31:16 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:16 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6" returned: 0 in 0.330s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] Lock "cinder-quobyte-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6" released by "delete_volume" :: held 0.792s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] Created reservations ['e95244f1-5a5b-45a2-8044-34d99688030b', 'ecd9242a-16e5-4aff-939c-e9c91cf039d6', '8255d5b7-e2fa-443d-85b2-8686b70935ee', '42078bce-6636-4ccb-960f-beadc41438f2'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:16 devstack sudo[108427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:31:16 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:16 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9" returned: 0 in 0.405s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:16 devstack sudo[108430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9
Aug 12 16:31:16 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:16 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.298s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:31:16 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] Deleted volume successfully.
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c43dfaba-d1c7-4f7f-957c-e6e68e1e6cf6 tempest-AttachVolumeNegativeTest-157029580 None] Lock "cinder-7cffaed0-bb35-44ba-8f6b-0f7320e0a3c6-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] Acquiring lock "cinder-fff67eb1-4929-4e30-9dc1-a0e72d2298e6-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] Lock "cinder-fff67eb1-4929-4e30-9dc1-a0e72d2298e6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] Acquiring lock "cinder-quobyte-fff67eb1-4929-4e30-9dc1-a0e72d2298e6" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:16 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] Lock "cinder-quobyte-fff67eb1-4929-4e30-9dc1-a0e72d2298e6" acquired by "delete_volume" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653.ba359314-dee0-4c4a-8d6b-ac18b1b358c9" returned: 0 in 0.322s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:17 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[774e5eee-61c2-4d7a-89cb-e763f8ca292d]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fff67eb1-4929-4e30-9dc1-a0e72d2298e6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-ba359314-dee0-4c4a-8d6b-ac18b1b358c9" released by "_delete_snapshot" :: held 2.055s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-23aef795-2f71-4fa3-b2f5-15baa988b653" released by "delete_snapshot" :: held 2.104s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:17 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] Created reservations ['7837e328-9055-4f2a-bb16-d5c37cd23d39', 'a3bfa116-fc4b-44d7-b7b4-c749ef67fe8b', 'd10e4c31-301a-4c04-9049-577ca56666f0', '30769e16-2da1-4923-8133-5ee22b24a35c'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:31:17 devstack sudo[108434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fff67eb1-4929-4e30-9dc1-a0e72d2298e6
Aug 12 16:31:17 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:17 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] Delete snapshot completed successfully.
Aug 12 16:31:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-47699d7d-46ac-4fb9-b2c4-fb83df684e42 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-ba359314-dee0-4c4a-8d6b-ac18b1b358c9-delete_snapshot" released by "delete_snapshot" :: held 2.283s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:17 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fff67eb1-4929-4e30-9dc1-a0e72d2298e6" returned: 0 in 0.388s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fff67eb1-4929-4e30-9dc1-a0e72d2298e6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:17 devstack sudo[108439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fff67eb1-4929-4e30-9dc1-a0e72d2298e6
Aug 12 16:31:17 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:17 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fff67eb1-4929-4e30-9dc1-a0e72d2298e6" returned: 0 in 0.315s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] Lock "cinder-quobyte-fff67eb1-4929-4e30-9dc1-a0e72d2298e6" released by "delete_volume" :: held 0.778s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:17 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] Created reservations ['ff89c05b-a303-470a-98e5-53ac5239410e', '42f09503-5260-4b15-aef3-efa5511ec715', '522dd666-88ec-4233-88bc-2eb28a14068c', '7a9eddff-0c86-4c66-a279-bf28549d90f2'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:31:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:31:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:31:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:17 devstack sudo[108442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:31:17 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:18 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.299s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:18 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:31:18 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] Deleted volume successfully.
Aug 12 16:31:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-52916a80-6cd5-4ada-aa0d-f53056b6ec1d tempest-AttachVolumeNegativeTest-157029580 None] Lock "cinder-fff67eb1-4929-4e30-9dc1-a0e72d2298e6-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-23aef795-2f71-4fa3-b2f5-15baa988b653-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-23aef795-2f71-4fa3-b2f5-15baa988b653-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-quobyte-23aef795-2f71-4fa3-b2f5-15baa988b653" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-23aef795-2f71-4fa3-b2f5-15baa988b653" acquired by "delete_volume" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:18 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[33651be7-6bc9-4b59-8a72-3ec0970ec6f1]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:18 devstack sudo[108445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653
Aug 12 16:31:18 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:18 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653" returned: 0 in 0.428s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:18 devstack sudo[108450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653
Aug 12 16:31:18 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:19 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-23aef795-2f71-4fa3-b2f5-15baa988b653" returned: 0 in 0.302s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-23aef795-2f71-4fa3-b2f5-15baa988b653" released by "delete_volume" :: held 0.808s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] Created reservations ['11a57669-1b03-40e0-b5f4-9e10e83c4fc0', '5fac5d52-9772-4e97-90ce-a7c9d206867c', '5299b3b7-a630-41a6-a192-a4e8d555c3f8', '49ad56b4-3a10-40e9-91ae-3f7a67c425e9'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:19 devstack sudo[108453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:31:19 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:19 devstack sudo[108455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:31:19 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:19 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.359s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:31:19 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] Deleted volume successfully.
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-06109fda-456b-41c1-a9a6-2a08bd4c45b3 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-23aef795-2f71-4fa3-b2f5-15baa988b653-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:19 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.493s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 29 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:31:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>, <Thread(Rabbit-heartbeat, started daemon 134532925736384)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Flow 'volume_create_manager' (35d11bae-68bd-4b21-89bf-b624e3aa0044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d015af0-9de5-47c2-aef1-61d9eae09c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d015af0-9de5-47c2-aef1-61d9eae09c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1917214778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb31186e-37d5-4329-abaf-67cf00cb44fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7073b366fdba40f6b9c33835e1d9aaeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:31:20Z,use_quota=True,user_id='2f1426cae6a5413d99ba85733daf2e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a393c2b9-37b0-4ede-a1e4-212784bc4165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a393c2b9-37b0-4ede-a1e4-212784bc4165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1671f4-a0b4-40f7-b571-59bfca940916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1671f4-a0b4-40f7-b571-59bfca940916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb31186e-37d5-4329-abaf-67cf00cb44fb', 'volume_name': 'volume-bb31186e-37d5-4329-abaf-67cf00cb44fb', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54df4314-28f8-4386-9521-a86352280b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54df4314-28f8-4386-9521-a86352280b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5a9b12-1d1f-4889-83ae-cb8f9f822d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:20 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Volume bb31186e-37d5-4329-abaf-67cf00cb44fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb31186e-37d5-4329-abaf-67cf00cb44fb', 'volume_size': 1}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1917214778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb31186e-37d5-4329-abaf-67cf00cb44fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7073b366fdba40f6b9c33835e1d9aaeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:31:20Z,use_quota=True,user_id='2f1426cae6a5413d99ba85733daf2e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Creating volume bb31186e-37d5-4329-abaf-67cf00cb44fb {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:31:20 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:20 devstack sudo[108461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb 1073741824
Aug 12 16:31:20 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:20 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb 1073741824" returned: 0 in 0.575s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:20 devstack sudo[108466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb
Aug 12 16:31:20 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:21 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb" returned: 0 in 0.315s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:31:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f5a9b12-1d1f-4889-83ae-cb8f9f822d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb31186e-37d5-4329-abaf-67cf00cb44fb', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1031e63d-d32d-424d-a656-d6f6952764e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:21 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Volume volume-bb31186e-37d5-4329-abaf-67cf00cb44fb (bb31186e-37d5-4329-abaf-67cf00cb44fb): created successfully
Aug 12 16:31:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1031e63d-d32d-424d-a656-d6f6952764e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Flow 'volume_create_manager' (35d11bae-68bd-4b21-89bf-b624e3aa0044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:31:21 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-33b47e5c-4c9e-4f89-a536-251897c4a555 tempest-VolumesSnapshotTestJSON-656818206 None] Created volume successfully.
Aug 12 16:31:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b2809df2-bdca-467a-9c8a-1b0983a9ce20 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b2809df2-bdca-467a-9c8a-1b0983a9ce20 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-b2809df2-bdca-467a-9c8a-1b0983a9ce20 tempest-VolumesSnapshotTestJSON-656818206 None] Creating offline snapshot 8e748e50-444a-484f-b7b9-3f8d8ac62ffe of volume bb31186e-37d5-4329-abaf-67cf00cb44fb {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:31:22 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f83fb20-c526-4ebd-93a0-f13ebfddc5fc]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b2809df2-bdca-467a-9c8a-1b0983a9ce20 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:22 devstack sudo[108469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb
Aug 12 16:31:22 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:23 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b2809df2-bdca-467a-9c8a-1b0983a9ce20 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb" returned: 0 in 0.418s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b2809df2-bdca-467a-9c8a-1b0983a9ce20 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:23 devstack sudo[108475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe 1G
Aug 12 16:31:23 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:23 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b2809df2-bdca-467a-9c8a-1b0983a9ce20 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe 1G" returned: 0 in 0.646s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b2809df2-bdca-467a-9c8a-1b0983a9ce20 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb31186e-37d5-4329-abaf-67cf00cb44fb -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:23 devstack sudo[108515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb31186e-37d5-4329-abaf-67cf00cb44fb -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe
Aug 12 16:31:23 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:24 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b2809df2-bdca-467a-9c8a-1b0983a9ce20 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb31186e-37d5-4329-abaf-67cf00cb44fb -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe" returned: 0 in 0.495s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:24 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-b2809df2-bdca-467a-9c8a-1b0983a9ce20 tempest-VolumesSnapshotTestJSON-656818206 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe is being set with open permissions: ugo+rw
Aug 12 16:31:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b2809df2-bdca-467a-9c8a-1b0983a9ce20 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:24 devstack sudo[108522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe
Aug 12 16:31:24 devstack sudo[108522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:24 devstack sudo[108522]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b2809df2-bdca-467a-9c8a-1b0983a9ce20 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe" returned: 0 in 0.344s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b2809df2-bdca-467a-9c8a-1b0983a9ce20 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:24 devstack sudo[108525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.info
Aug 12 16:31:24 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:24 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b2809df2-bdca-467a-9c8a-1b0983a9ce20 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.info" returned: 0 in 0.319s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:24 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-b2809df2-bdca-467a-9c8a-1b0983a9ce20 tempest-VolumesSnapshotTestJSON-656818206 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.info is being set with open permissions: ugo+rw
Aug 12 16:31:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b2809df2-bdca-467a-9c8a-1b0983a9ce20 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:24 devstack sudo[108528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.info
Aug 12 16:31:24 devstack sudo[108528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:25 devstack sudo[108528]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b2809df2-bdca-467a-9c8a-1b0983a9ce20 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.info" returned: 0 in 0.279s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b2809df2-bdca-467a-9c8a-1b0983a9ce20 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.627s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:25 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-b2809df2-bdca-467a-9c8a-1b0983a9ce20 tempest-VolumesSnapshotTestJSON-656818206 None] Create snapshot completed successfully
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Flow 'volume_create_manager' (2f993cd9-87fb-4755-9670-5f56eae4ee10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (599c0fa4-ece0-47b7-892f-2a74a6849a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (599c0fa4-ece0-47b7-892f-2a74a6849a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-247539734',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9605ea18-a27b-45c3-8c0c-9aa884e28a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7073b366fdba40f6b9c33835e1d9aaeb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8e748e50-444a-484f-b7b9-3f8d8ac62ffe,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:31:26Z,use_quota=True,user_id='2f1426cae6a5413d99ba85733daf2e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4f9dca-563d-4a90-996d-98eca17d2ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4f9dca-563d-4a90-996d-98eca17d2ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354742c9-2b79-49ef-bd92-36e792fcc925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354742c9-2b79-49ef-bd92-36e792fcc925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9605ea18-a27b-45c3-8c0c-9aa884e28a28', 'volume_name': 'volume-9605ea18-a27b-45c3-8c0c-9aa884e28a28', 'volume_size': 1, 'snapshot_id': '8e748e50-444a-484f-b7b9-3f8d8ac62ffe'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8b73a2-6c92-4d18-a55f-04b9c0ebb5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb8b73a2-6c92-4d18-a55f-04b9c0ebb5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e4828d-2298-4632-9dfa-726720216567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:26 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Volume 9605ea18-a27b-45c3-8c0c-9aa884e28a28: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9605ea18-a27b-45c3-8c0c-9aa884e28a28', 'volume_size': 1, 'snapshot_id': '8e748e50-444a-484f-b7b9-3f8d8ac62ffe'}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-quobyte-8e748e50-444a-484f-b7b9-3f8d8ac62ffe-9605ea18-a27b-45c3-8c0c-9aa884e28a28" by "_create_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-8e748e50-444a-484f-b7b9-3f8d8ac62ffe-9605ea18-a27b-45c3-8c0c-9aa884e28a28" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Creating volume 9605ea18-a27b-45c3-8c0c-9aa884e28a28 from snapshot 8e748e50-444a-484f-b7b9-3f8d8ac62ffe {{(pid=94457) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-quobyte-9605ea18-a27b-45c3-8c0c-9aa884e28a28" by "_copy_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-9605ea18-a27b-45c3-8c0c-9aa884e28a28" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] snapshot: 8e748e50-444a-484f-b7b9-3f8d8ac62ffe, volume: 9605ea18-a27b-45c3-8c0c-9aa884e28a28,  {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88ff0e8-8083-42e0-bd1d-56a0bbfe396e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:26 devstack sudo[108531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe
Aug 12 16:31:26 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:27 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe" returned: 0 in 0.453s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb31186e-37d5-4329-abaf-67cf00cb44fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:31:27 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a649ff6-4a31-48e0-84df-de1c93d5e796]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:27 devstack sudo[108536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb
Aug 12 16:31:27 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:27 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb" returned: 0 in 0.460s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 12 16:31:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Creating direct copy from snapshot {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 12 16:31:27 devstack cinder-volume[94457]: DEBUG cinder.utils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Path /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9605ea18-a27b-45c3-8c0c-9aa884e28a28 not found in is_blk_device check {{(pid=94457) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 12 16:31:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9605ea18-a27b-45c3-8c0c-9aa884e28a28 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:27 devstack sudo[108541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9605ea18-a27b-45c3-8c0c-9aa884e28a28
Aug 12 16:31:27 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:27 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:31:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Flow 'volume_create_manager' (509d4ee5-3bf4-42e5-a2da-034a88cc53ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:31:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e465db6-bbc4-4e0b-b8d7-a5af39842c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e465db6-bbc4-4e0b-b8d7-a5af39842c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1351161872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b88ce1-64b3-44d1-a6a4-4ff93c248091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b449259c0984da58d3993af40c8152c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:31:28Z,use_quota=True,user_id='73d93a29808249beacf3ad7dd899f70b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e799f7a-d3e6-460e-a2cc-13c43b63ca71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e799f7a-d3e6-460e-a2cc-13c43b63ca71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0aa38fa-a68f-4354-a7b7-af85670d99e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0aa38fa-a68f-4354-a7b7-af85670d99e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93b88ce1-64b3-44d1-a6a4-4ff93c248091', 'volume_name': 'volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21795dac-2b68-4cbe-9c9d-fbd706f605bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21795dac-2b68-4cbe-9c9d-fbd706f605bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219db950-91dc-4670-9afa-5c6b7b640ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:28 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Volume 93b88ce1-64b3-44d1-a6a4-4ff93c248091: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091', 'volume_size': 1}
Aug 12 16:31:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:28 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:31:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Flow 'volume_create_manager' (c8114efe-becf-4038-8d1c-6e32329aaf17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:31:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ffa2a53-6b35-4450-88c6-7e978a9b0704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ffa2a53-6b35-4450-88c6-7e978a9b0704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1971545878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3902aaa8-1477-41fb-a493-e15a72917659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='232a5ff5669445e096d2b2b1ebaa9a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:31:29Z,use_quota=True,user_id='8384aeff839b46e6918f3de07c7a1c1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d1a10b-baee-4e24-a3b5-7b49c8d4504c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d1a10b-baee-4e24-a3b5-7b49c8d4504c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f281d5-2750-47d3-9a1c-69e13ef109ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:28 devstack cinder-volume[94457]: DEBUG cinder.image.glance [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Creating Keystone auth plugin from conf {{(pid=94457) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 12 16:31:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3f281d5-2750-47d3-9a1c-69e13ef109ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3902aaa8-1477-41fb-a493-e15a72917659', 'volume_name': 'volume-3902aaa8-1477-41fb-a493-e15a72917659', 'volume_size': 1, 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b7d6f6e2f82493fb2262e877eaef313', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'created_at': datetime.datetime(2026, 8, 12, 14, 14, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 14, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86433006-753f-43b5-b60e-7f6f6c1c77c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b633f4440>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9535fb36-462c-41ac-b433-825737c2a65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9535fb36-462c-41ac-b433-825737c2a65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6decfc70-74f8-4260-b073-e6ab4afc7071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:29 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Volume 3902aaa8-1477-41fb-a493-e15a72917659: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3902aaa8-1477-41fb-a493-e15a72917659', 'volume_size': 1, 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b7d6f6e2f82493fb2262e877eaef313', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'created_at': datetime.datetime(2026, 8, 12, 14, 14, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 14, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86433006-753f-43b5-b60e-7f6f6c1c77c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b633f4440>}
Aug 12 16:31:29 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Trying to clone 3902aaa8-1477-41fb-a493-e15a72917659 from image 86433006-753f-43b5-b60e-7f6f6c1c77c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]). {{(pid=94457) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 12 16:31:30 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_j1bb_hi1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 12 16:31:30 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Image download 20.69 MB at 20.69 MB/s
Aug 12 16:31:30 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[233eed2d-1432-49b3-b489-2c7290be56d7]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_j1bb_hi1devstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:31 devstack sudo[108556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_j1bb_hi1devstack@QuobyteHD
Aug 12 16:31:31 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:31 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_j1bb_hi1devstack@QuobyteHD" returned: 0 in 0.673s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:31 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Temporary image 86433006-753f-43b5-b60e-7f6f6c1c77c6 is fetched for user 8384aeff839b46e6918f3de07c7a1c1a. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 12 16:31:31 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7e86a0-8ff8-454a-9b60-bb8cd5f6b188]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_j1bb_hi1devstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:32 devstack sudo[108562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_j1bb_hi1devstack@QuobyteHD
Aug 12 16:31:32 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:32 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_j1bb_hi1devstack@QuobyteHD" returned: 0 in 0.742s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:32 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9605ea18-a27b-45c3-8c0c-9aa884e28a28" returned: 0 in 5.054s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9605ea18-a27b-45c3-8c0c-9aa884e28a28 {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:31:32 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Converted 1024.00 MB image at 202.59 MB/s
Aug 12 16:31:32 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9605ea18-a27b-45c3-8c0c-9aa884e28a28 is being set with open permissions: ugo+rw
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9605ea18-a27b-45c3-8c0c-9aa884e28a28 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:32 devstack sudo[108567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9605ea18-a27b-45c3-8c0c-9aa884e28a28
Aug 12 16:31:32 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:32 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9605ea18-a27b-45c3-8c0c-9aa884e28a28" returned: 0 in 0.246s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-9605ea18-a27b-45c3-8c0c-9aa884e28a28" released by "_copy_volume_from_snapshot" :: held 6.324s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-8e748e50-444a-484f-b7b9-3f8d8ac62ffe-9605ea18-a27b-45c3-8c0c-9aa884e28a28" released by "_create_volume_from_snapshot" :: held 6.393s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.410s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.863s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1351161872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93b88ce1-64b3-44d1-a6a4-4ff93c248091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b449259c0984da58d3993af40c8152c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:31:28Z,use_quota=True,user_id='73d93a29808249beacf3ad7dd899f70b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Creating volume 93b88ce1-64b3-44d1-a6a4-4ff93c248091 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:31:32 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:32 devstack sudo[108570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091 1073741824
Aug 12 16:31:32 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e4828d-2298-4632-9dfa-726720216567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9605ea18-a27b-45c3-8c0c-9aa884e28a28', 'volume_size': 1, 'snapshot_id': '8e748e50-444a-484f-b7b9-3f8d8ac62ffe'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3909ed7d-4007-41c0-91ef-e024a2266f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:33 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Volume volume-9605ea18-a27b-45c3-8c0c-9aa884e28a28 (9605ea18-a27b-45c3-8c0c-9aa884e28a28): created successfully
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3909ed7d-4007-41c0-91ef-e024a2266f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Flow 'volume_create_manager' (2f993cd9-87fb-4755-9670-5f56eae4ee10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:31:33 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5edc67cb-137d-4632-990a-9303e7e55e0b tempest-VolumesSnapshotTestJSON-656818206 None] Created volume successfully.
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-9605ea18-a27b-45c3-8c0c-9aa884e28a28-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-9605ea18-a27b-45c3-8c0c-9aa884e28a28-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-quobyte-9605ea18-a27b-45c3-8c0c-9aa884e28a28" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-9605ea18-a27b-45c3-8c0c-9aa884e28a28" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5badeef-8d37-413b-bfa3-0918de54c085]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9605ea18-a27b-45c3-8c0c-9aa884e28a28 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:33 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091 1073741824" returned: 0 in 0.519s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:33 devstack sudo[108581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9605ea18-a27b-45c3-8c0c-9aa884e28a28
Aug 12 16:31:33 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:33 devstack sudo[108582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091
Aug 12 16:31:33 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:33 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091" returned: 0 in 0.256s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.139s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1971545878',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3902aaa8-1477-41fb-a493-e15a72917659,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='232a5ff5669445e096d2b2b1ebaa9a08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:31:29Z,use_quota=True,user_id='8384aeff839b46e6918f3de07c7a1c1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Creating volume 3902aaa8-1477-41fb-a493-e15a72917659 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:31:33 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:31:33 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3902aaa8-1477-41fb-a493-e15a72917659 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9605ea18-a27b-45c3-8c0c-9aa884e28a28" returned: 0 in 0.391s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9605ea18-a27b-45c3-8c0c-9aa884e28a28 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:33 devstack sudo[108589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3902aaa8-1477-41fb-a493-e15a72917659 1073741824
Aug 12 16:31:33 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (219db950-91dc-4670-9afa-5c6b7b640ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3edd63d-6b7e-4759-895a-58d6c955f74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:33 devstack sudo[108590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9605ea18-a27b-45c3-8c0c-9aa884e28a28
Aug 12 16:31:33 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:33 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Volume volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091 (93b88ce1-64b3-44d1-a6a4-4ff93c248091): created successfully
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3edd63d-6b7e-4759-895a-58d6c955f74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Flow 'volume_create_manager' (509d4ee5-3bf4-42e5-a2da-034a88cc53ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:31:33 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-ff8fd2d1-f74a-4a4e-bc01-43ec65a15808 req-0bf19f77-e294-4041-adc7-0b70de76f1ad tempest-VolumesSnapshotsTestJSON-1129342976 None] Created volume successfully.
Aug 12 16:31:34 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9605ea18-a27b-45c3-8c0c-9aa884e28a28" returned: 0 in 0.291s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-9605ea18-a27b-45c3-8c0c-9aa884e28a28" released by "delete_volume" :: held 0.726s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] Created reservations ['302b93f6-57c9-4dbb-8284-920560dd5b1d', 'cfd226e0-8f1a-40b7-ba8e-daddb915d49c', 'd3ced063-0c62-4eb0-a51c-4f0e6637dbab', '6279e045-2d46-445b-b39b-b6a00359138d'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:31:34 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3902aaa8-1477-41fb-a493-e15a72917659 1073741824" returned: 0 in 0.438s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3902aaa8-1477-41fb-a493-e15a72917659 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:34 devstack sudo[108598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:31:34 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:34 devstack sudo[108600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3902aaa8-1477-41fb-a493-e15a72917659
Aug 12 16:31:34 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-8e748e50-444a-484f-b7b9-3f8d8ac62ffe-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:34 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3902aaa8-1477-41fb-a493-e15a72917659" returned: 0 in 0.260s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:34 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.299s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:31:34 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] Deleted volume successfully.
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-8e748e50-444a-484f-b7b9-3f8d8ac62ffe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-quobyte-bb31186e-37d5-4329-abaf-67cf00cb44fb" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-bb31186e-37d5-4329-abaf-67cf00cb44fb" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-quobyte-8e748e50-444a-484f-b7b9-3f8d8ac62ffe" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-799da4dd-a1ad-4a1f-8d9c-eccee4932715 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-9605ea18-a27b-45c3-8c0c-9aa884e28a28-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Attempting download of 86433006-753f-43b5-b60e-7f6f6c1c77c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}])) to volume 3902aaa8-1477-41fb-a493-e15a72917659. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-8e748e50-444a-484f-b7b9-3f8d8ac62ffe" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] Deleting offline snapshot 8e748e50-444a-484f-b7b9-3f8d8ac62ffe of volume bb31186e-37d5-4329-abaf-67cf00cb44fb {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] snapshot_file for this snap is: volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[384bb470-3e9d-4a88-b569-9736752ebaa5]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21b79d4-6578-4454-a04a-d6db3db3cd11]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_v48ji32o {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:34 devstack sudo[108604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe
Aug 12 16:31:34 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:34 devstack sudo[108605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_v48ji32o
Aug 12 16:31:34 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:34 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_v48ji32o" returned: 0 in 0.337s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_v48ji32o {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:34 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe" returned: 0 in 0.378s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb31186e-37d5-4329-abaf-67cf00cb44fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53851e3-2b54-41ee-9d4f-4dd822cf163d]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:35 devstack sudo[108613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_v48ji32o
Aug 12 16:31:35 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:35 devstack sudo[108614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb
Aug 12 16:31:35 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-e4b28ce7-574e-4db7-ba5e-a8df108e5440 req-bfebee73-769a-4b6c-b4c4-77ff035db406 tempest-VolumesSnapshotsTestJSON-1129342976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-e4b28ce7-574e-4db7-ba5e-a8df108e5440 req-bfebee73-769a-4b6c-b4c4-77ff035db406 tempest-VolumesSnapshotsTestJSON-1129342976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [req-e4b28ce7-574e-4db7-ba5e-a8df108e5440 req-bfebee73-769a-4b6c-b4c4-77ff035db406 tempest-VolumesSnapshotsTestJSON-1129342976 None] Creating offline snapshot fc9f0add-b3bf-4012-b764-c2093a318e9c of volume 93b88ce1-64b3-44d1-a6a4-4ff93c248091 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f2a5e2-6f38-4786-89ba-978c79701e85]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-e4b28ce7-574e-4db7-ba5e-a8df108e5440 req-bfebee73-769a-4b6c-b4c4-77ff035db406 tempest-VolumesSnapshotsTestJSON-1129342976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:35 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_v48ji32o" returned: 1 in 0.406s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_v48ji32o' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[685fbca0-37ac-4b38-825b-2a2ca2ffca30]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_j1bb_hi1devstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:35 devstack sudo[108617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091
Aug 12 16:31:35 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:35 devstack sudo[108620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_j1bb_hi1devstack@QuobyteHD
Aug 12 16:31:35 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:35 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-e4b28ce7-574e-4db7-ba5e-a8df108e5440 req-bfebee73-769a-4b6c-b4c4-77ff035db406 tempest-VolumesSnapshotsTestJSON-1129342976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091" returned: 0 in 0.434s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-e4b28ce7-574e-4db7-ba5e-a8df108e5440 req-bfebee73-769a-4b6c-b4c4-77ff035db406 tempest-VolumesSnapshotsTestJSON-1129342976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:35 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb" returned: 0 in 0.666s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:35 devstack sudo[108629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c 1G
Aug 12 16:31:35 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:35 devstack sudo[108630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe
Aug 12 16:31:35 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:35 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_j1bb_hi1devstack@QuobyteHD" returned: 0 in 0.373s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] 86433006-753f-43b5-b60e-7f6f6c1c77c6 was qcow2, converting to qcow2 {{(pid=94457) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 12 16:31:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_j1bb_hi1devstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3902aaa8-1477-41fb-a493-e15a72917659 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:35 devstack sudo[108636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_j1bb_hi1devstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3902aaa8-1477-41fb-a493-e15a72917659
Aug 12 16:31:35 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:36 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe" returned: 0 in 0.370s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:36 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-e4b28ce7-574e-4db7-ba5e-a8df108e5440 req-bfebee73-769a-4b6c-b4c4-77ff035db406 tempest-VolumesSnapshotsTestJSON-1129342976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c 1G" returned: 0 in 0.413s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-e4b28ce7-574e-4db7-ba5e-a8df108e5440 req-bfebee73-769a-4b6c-b4c4-77ff035db406 tempest-VolumesSnapshotsTestJSON-1129342976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:36 devstack sudo[108648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe
Aug 12 16:31:36 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:36 devstack sudo[108651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c
Aug 12 16:31:36 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:36 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb.8e748e50-444a-484f-b7b9-3f8d8ac62ffe" returned: 0 in 0.276s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-8e748e50-444a-484f-b7b9-3f8d8ac62ffe" released by "_delete_snapshot" :: held 1.813s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-bb31186e-37d5-4329-abaf-67cf00cb44fb" released by "delete_snapshot" :: held 1.839s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:36 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-e4b28ce7-574e-4db7-ba5e-a8df108e5440 req-bfebee73-769a-4b6c-b4c4-77ff035db406 tempest-VolumesSnapshotsTestJSON-1129342976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c" returned: 0 in 0.330s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:36 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [req-e4b28ce7-574e-4db7-ba5e-a8df108e5440 req-bfebee73-769a-4b6c-b4c4-77ff035db406 tempest-VolumesSnapshotsTestJSON-1129342976 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c is being set with open permissions: ugo+rw
Aug 12 16:31:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-e4b28ce7-574e-4db7-ba5e-a8df108e5440 req-bfebee73-769a-4b6c-b4c4-77ff035db406 tempest-VolumesSnapshotsTestJSON-1129342976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:36 devstack sudo[108661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c
Aug 12 16:31:36 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:36 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] Created reservations ['51643fad-aa1d-4808-9f84-90c17362e8b1', 'ffaadc22-0c7f-41b4-a1e6-9a67f48c5568', 'cc1b4f68-dfd9-437b-8158-557cae4629c8', 'd3a5fd64-256b-454b-99be-cc975b7f7e8d'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:31:36 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] Delete snapshot completed successfully.
Aug 12 16:31:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e99e8caa-4f61-46a7-86fa-4c29eb1015b4 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-8e748e50-444a-484f-b7b9-3f8d8ac62ffe-delete_snapshot" released by "delete_snapshot" :: held 2.082s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-bb31186e-37d5-4329-abaf-67cf00cb44fb-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:36 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-e4b28ce7-574e-4db7-ba5e-a8df108e5440 req-bfebee73-769a-4b6c-b4c4-77ff035db406 tempest-VolumesSnapshotsTestJSON-1129342976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c" returned: 0 in 0.360s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-bb31186e-37d5-4329-abaf-67cf00cb44fb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-e4b28ce7-574e-4db7-ba5e-a8df108e5440 req-bfebee73-769a-4b6c-b4c4-77ff035db406 tempest-VolumesSnapshotsTestJSON-1129342976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-quobyte-bb31186e-37d5-4329-abaf-67cf00cb44fb" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:36 devstack sudo[108664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.info
Aug 12 16:31:36 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-bb31186e-37d5-4329-abaf-67cf00cb44fb" acquired by "delete_volume" :: waited 0.020s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:36 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb630b8-0194-4b44-9134-ee9a6a81d76f]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:37 devstack sudo[108666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb
Aug 12 16:31:37 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:37 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-e4b28ce7-574e-4db7-ba5e-a8df108e5440 req-bfebee73-769a-4b6c-b4c4-77ff035db406 tempest-VolumesSnapshotsTestJSON-1129342976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.info" returned: 0 in 0.298s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:37 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [req-e4b28ce7-574e-4db7-ba5e-a8df108e5440 req-bfebee73-769a-4b6c-b4c4-77ff035db406 tempest-VolumesSnapshotsTestJSON-1129342976 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.info is being set with open permissions: ugo+rw
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-e4b28ce7-574e-4db7-ba5e-a8df108e5440 req-bfebee73-769a-4b6c-b4c4-77ff035db406 tempest-VolumesSnapshotsTestJSON-1129342976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:37 devstack sudo[108669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.info
Aug 12 16:31:37 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:37 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb" returned: 0 in 0.392s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:37 devstack sudo[108674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb
Aug 12 16:31:37 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:37 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-e4b28ce7-574e-4db7-ba5e-a8df108e5440 req-bfebee73-769a-4b6c-b4c4-77ff035db406 tempest-VolumesSnapshotsTestJSON-1129342976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.info" returned: 0 in 0.284s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-e4b28ce7-574e-4db7-ba5e-a8df108e5440 req-bfebee73-769a-4b6c-b4c4-77ff035db406 tempest-VolumesSnapshotsTestJSON-1129342976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.256s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:37 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-e4b28ce7-574e-4db7-ba5e-a8df108e5440 req-bfebee73-769a-4b6c-b4c4-77ff035db406 tempest-VolumesSnapshotsTestJSON-1129342976 None] Create snapshot completed successfully
Aug 12 16:31:37 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb31186e-37d5-4329-abaf-67cf00cb44fb" returned: 0 in 0.326s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] Acquiring lock "cinder-fc9f0add-b3bf-4012-b764-c2093a318e9c-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-bb31186e-37d5-4329-abaf-67cf00cb44fb" released by "delete_volume" :: held 0.810s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] Lock "cinder-fc9f0add-b3bf-4012-b764-c2093a318e9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] Acquiring lock "cinder-quobyte-93b88ce1-64b3-44d1-a6a4-4ff93c248091" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] Lock "cinder-quobyte-93b88ce1-64b3-44d1-a6a4-4ff93c248091" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] Acquiring lock "cinder-quobyte-fc9f0add-b3bf-4012-b764-c2093a318e9c" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:37 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_j1bb_hi1devstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3902aaa8-1477-41fb-a493-e15a72917659" returned: 0 in 1.993s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_j1bb_hi1devstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3902aaa8-1477-41fb-a493-e15a72917659 {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:31:37 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Converted 112.00 MB image at 56.18 MB/s
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3902aaa8-1477-41fb-a493-e15a72917659 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] Lock "cinder-quobyte-fc9f0add-b3bf-4012-b764-c2093a318e9c" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] Deleting offline snapshot fc9f0add-b3bf-4012-b764-c2093a318e9c of volume 93b88ce1-64b3-44d1-a6a4-4ff93c248091 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:31:37 devstack sudo[108678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3902aaa8-1477-41fb-a493-e15a72917659 1G
Aug 12 16:31:37 devstack sudo[108678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] snapshot_file for this snap is: volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd12283-4e14-41d9-a21b-7c167f5203ff]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] Created reservations ['67bf7ca0-9bb0-438d-886b-325e7cc784ab', '3f49cfd0-fcd3-439c-bd73-3ee207f1b20e', 'da6ea849-59a1-4f05-962c-f43b138b4a74', 'fde044e2-2263-43bc-b5a3-1e6214005f7e'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:37 devstack sudo[108680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c
Aug 12 16:31:37 devstack sudo[108680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:37 devstack sudo[108682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:31:37 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-4471d167-873f-4fb0-b316-285f7ba2bf4b-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-4471d167-873f-4fb0-b316-285f7ba2bf4b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "cinder-quobyte-4471d167-873f-4fb0-b316-285f7ba2bf4b" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:38 devstack sudo[108678]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3902aaa8-1477-41fb-a493-e15a72917659 1G" returned: 0 in 0.418s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Downloaded image 86433006-753f-43b5-b60e-7f6f6c1c77c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}])) to volume 3902aaa8-1477-41fb-a493-e15a72917659 successfully. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Temporary image 86433006-753f-43b5-b60e-7f6f6c1c77c6 for user 8384aeff839b46e6918f3de07c7a1c1a is deleted. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Marking volume 3902aaa8-1477-41fb-a493-e15a72917659 as bootable. {{(pid=94457) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-4471d167-873f-4fb0-b316-285f7ba2bf4b" acquired by "delete_volume" :: waited 0.033s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Copying metadata from image 86433006-753f-43b5-b60e-7f6f6c1c77c6 to 3902aaa8-1477-41fb-a493-e15a72917659. {{(pid=94457) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Creating volume glance metadata for volume 3902aaa8-1477-41fb-a493-e15a72917659 backed by image 86433006-753f-43b5-b60e-7f6f6c1c77c6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94457) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bcf331-1ebb-4bec-8786-5e780526ba70]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:38 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.345s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:31:38 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] Deleted volume successfully.
Aug 12 16:31:38 devstack sudo[108680]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c5d24fdf-0e1c-4f5f-b549-803dbf78bb90 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-bb31186e-37d5-4329-abaf-67cf00cb44fb-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c" returned: 0 in 0.504s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c892d6-91ef-41b8-9adc-95822bc4d1c0]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:38 devstack sudo[108693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b
Aug 12 16:31:38 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6decfc70-74f8-4260-b073-e6ab4afc7071) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3902aaa8-1477-41fb-a493-e15a72917659', 'volume_size': 1, 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b7d6f6e2f82493fb2262e877eaef313', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'created_at': datetime.datetime(2026, 8, 12, 14, 14, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 14, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86433006-753f-43b5-b60e-7f6f6c1c77c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b633f4440>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c52fb69d-6efc-4b41-ae79-faffc6202cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:31:38 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Volume volume-3902aaa8-1477-41fb-a493-e15a72917659 (3902aaa8-1477-41fb-a493-e15a72917659): created successfully
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c52fb69d-6efc-4b41-ae79-faffc6202cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Flow 'volume_create_manager' (c8114efe-becf-4038-8d1c-6e32329aaf17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:31:38 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-3b01cfb8-4792-4914-b5ac-37c87ce3d946 tempest-TestShelveInstance-1732532078 None] Created volume successfully.
Aug 12 16:31:38 devstack sudo[108694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091
Aug 12 16:31:38 devstack sudo[108694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:38 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b" returned: 0 in 0.381s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:38 devstack sudo[108700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b
Aug 12 16:31:38 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:38 devstack sudo[108694]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091" returned: 0 in 0.400s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:38 devstack sudo[108705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c
Aug 12 16:31:38 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:38 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4471d167-873f-4fb0-b316-285f7ba2bf4b" returned: 0 in 0.276s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-quobyte-4471d167-873f-4fb0-b316-285f7ba2bf4b" released by "delete_volume" :: held 0.726s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:38 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] Created reservations ['749214f7-a7ac-4a3a-b2ff-0b35c09dcde7', '8f05be56-04c9-48cf-8d95-c2836ff4018f', '8bea4904-1676-497a-a428-dc574998a513', 'd9634e7e-4a05-48da-9899-6ccb8b9f9618'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:31:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:31:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:31:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:39 devstack sudo[108712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:31:39 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:39 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c" returned: 0 in 0.436s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:39 devstack sudo[108714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c
Aug 12 16:31:39 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:39 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.284s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:39 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:31:39 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] Deleted volume successfully.
Aug 12 16:31:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cea8ec22-4e91-4a96-8aeb-ba8bf1351399 tempest-VolumesSnapshotTestJSON-656818206 None] Lock "cinder-4471d167-873f-4fb0-b316-285f7ba2bf4b-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:39 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091.fc9f0add-b3bf-4012-b764-c2093a318e9c" returned: 0 in 0.293s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] Lock "cinder-quobyte-fc9f0add-b3bf-4012-b764-c2093a318e9c" released by "_delete_snapshot" :: held 1.750s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] Lock "cinder-quobyte-93b88ce1-64b3-44d1-a6a4-4ff93c248091" released by "delete_snapshot" :: held 1.793s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:39 devstack cinder-volume[94457]: DEBUG cinder.quota [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] Created reservations ['34850079-1cad-4003-b173-338969690ddd', '204997e8-e079-426d-a9ad-bdf86f508846', '43331c6a-55e0-4dae-a589-a32c003965bf', '53044674-feeb-41a3-a693-9e306281bbdb'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:31:39 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] Delete snapshot completed successfully.
Aug 12 16:31:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-19b7259b-5cfc-4495-b0bd-be80ca35de21 req-f01dad15-1b2a-42bf-b005-4f5f10ad1b05 tempest-VolumesSnapshotsTestJSON-1129342976 None] Lock "cinder-fc9f0add-b3bf-4012-b764-c2093a318e9c-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] Acquiring lock "cinder-93b88ce1-64b3-44d1-a6a4-4ff93c248091-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] Lock "cinder-93b88ce1-64b3-44d1-a6a4-4ff93c248091-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] Acquiring lock "cinder-quobyte-93b88ce1-64b3-44d1-a6a4-4ff93c248091" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:31:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] Lock "cinder-quobyte-93b88ce1-64b3-44d1-a6a4-4ff93c248091" acquired by "delete_volume" :: waited 0.042s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:31:40 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33b2215-5528-45a5-8655-469bdd7a8294]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:31:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:40 devstack sudo[108722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091
Aug 12 16:31:40 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:40 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091" returned: 0 in 0.442s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:40 devstack sudo[108729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091
Aug 12 16:31:40 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:41 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-93b88ce1-64b3-44d1-a6a4-4ff93c248091" returned: 0 in 0.339s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] Lock "cinder-quobyte-93b88ce1-64b3-44d1-a6a4-4ff93c248091" released by "delete_volume" :: held 0.882s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:41 devstack cinder-volume[94457]: DEBUG cinder.quota [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] Created reservations ['bba26eba-19ab-4473-b031-fcc169fb7c97', 'd2ff518b-1776-49a5-9172-d36367a478da', '510587f2-6d87-429e-93f8-56ce1f265e7a', '33a1b967-710a-4280-861b-bc34e825bd81'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:31:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:41 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:31:41 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:31:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:41 devstack sudo[108733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:31:41 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:41 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.452s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:41 devstack cinder-volume[94457]: DEBUG cinder.manager [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:31:41 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] Deleted volume successfully.
Aug 12 16:31:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-a061f016-384a-46ba-a0b1-3a583aa9258d req-59086aa7-ee98-4619-a701-e46e9758f10a tempest-VolumesSnapshotsTestJSON-1129342976 None] Lock "cinder-93b88ce1-64b3-44d1-a6a4-4ff93c248091-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:31:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-5f3dd14a-68ad-41c3-b3c3-e7e6c7d88136 req-80ca704f-a367-4d65-bee2-3c271d1fe896 tempest-TestShelveInstance-1732532078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-5f3dd14a-68ad-41c3-b3c3-e7e6c7d88136 req-80ca704f-a367-4d65-bee2-3c271d1fe896 tempest-TestShelveInstance-1732532078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-5f3dd14a-68ad-41c3-b3c3-e7e6c7d88136 req-80ca704f-a367-4d65-bee2-3c271d1fe896 tempest-TestShelveInstance-1732532078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-5f3dd14a-68ad-41c3-b3c3-e7e6c7d88136 req-80ca704f-a367-4d65-bee2-3c271d1fe896 tempest-TestShelveInstance-1732532078 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-3902aaa8-1477-41fb-a493-e15a72917659', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96e84b1b-62c9-45ef-9cda-7c7332f4535c', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:31:41 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-5f3dd14a-68ad-41c3-b3c3-e7e6c7d88136 req-80ca704f-a367-4d65-bee2-3c271d1fe896 tempest-TestShelveInstance-1732532078 None] attachment_update completed successfully.
Aug 12 16:31:51 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:UPDATE=119,cinder:SELECT=116,cinder:DELETE=9,cinder:INSERT=36 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:31:51 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=108,cinder:INSERT=39,cinder:UPDATE=130,cinder:DELETE=11 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:31:57 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-12a5ac19-0416-444c-8019-0f774586dc74 tempest-GroupsV320Test-1762036280 None] Group tempest-GroupsV320Test-Group-1248223787: creating
Aug 12 16:31:57 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-12a5ac19-0416-444c-8019-0f774586dc74 tempest-GroupsV320Test-1762036280 None] Group tempest-GroupsV320Test-Group-1248223787: created successfully
Aug 12 16:31:57 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-12a5ac19-0416-444c-8019-0f774586dc74 tempest-GroupsV320Test-1762036280 None] Create group completed successfully.
Aug 12 16:31:59 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-ee0a36d5-a2d8-4cc1-b608-f02e92289d4e tempest-GroupsV320Test-1762036280 None] Created reservations ['1cd6cc9b-6686-4c3b-a857-f9dc136890fd'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:31:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ee0a36d5-a2d8-4cc1-b608-f02e92289d4e tempest-GroupsV320Test-1762036280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:31:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ee0a36d5-a2d8-4cc1-b608-f02e92289d4e tempest-GroupsV320Test-1762036280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:31:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ee0a36d5-a2d8-4cc1-b608-f02e92289d4e tempest-GroupsV320Test-1762036280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:31:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ee0a36d5-a2d8-4cc1-b608-f02e92289d4e tempest-GroupsV320Test-1762036280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:31:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ee0a36d5-a2d8-4cc1-b608-f02e92289d4e tempest-GroupsV320Test-1762036280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:31:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ee0a36d5-a2d8-4cc1-b608-f02e92289d4e tempest-GroupsV320Test-1762036280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:31:59 devstack sudo[109215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:31:59 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:31:59 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root
Aug 12 16:31:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ee0a36d5-a2d8-4cc1-b608-f02e92289d4e tempest-GroupsV320Test-1762036280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.273s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:31:59 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-ee0a36d5-a2d8-4cc1-b608-f02e92289d4e tempest-GroupsV320Test-1762036280 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:31:59 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ee0a36d5-a2d8-4cc1-b608-f02e92289d4e tempest-GroupsV320Test-1762036280 None] Delete group completed successfully.
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Flow 'volume_create_manager' (1fb00208-802f-4279-80d9-8d879c4d792a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830599e1-faae-49b8-b315-f281e90927b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (830599e1-faae-49b8-b315-f281e90927b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1532232442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ecafcbb-d66a-4d4c-9bae-801c66207fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26929661071472ca015f10adea426e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:32:07Z,use_quota=True,user_id='6cff694fc02240e69e679ea3b82af7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd17d85-bec9-4d24-b2fa-c98ccb33b60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd17d85-bec9-4d24-b2fa-c98ccb33b60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bafc4ea-47c0-4190-967c-80316aeabefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bafc4ea-47c0-4190-967c-80316aeabefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ecafcbb-d66a-4d4c-9bae-801c66207fd1', 'volume_name': 'volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3ca6dd-d455-4c32-82fd-4cf93870e06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c3ca6dd-d455-4c32-82fd-4cf93870e06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce94fba6-69e9-48a8-8925-330bd74a6053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:06 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Volume 3ecafcbb-d66a-4d4c-9bae-801c66207fd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1', 'volume_size': 1}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1532232442',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ecafcbb-d66a-4d4c-9bae-801c66207fd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a26929661071472ca015f10adea426e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:32:07Z,use_quota=True,user_id='6cff694fc02240e69e679ea3b82af7b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Creating volume 3ecafcbb-d66a-4d4c-9bae-801c66207fd1 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:32:06 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:32:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:06 devstack sudo[109257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1 1073741824
Aug 12 16:32:06 devstack sudo[109257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:07 devstack sudo[109257]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1 1073741824" returned: 0 in 0.482s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:07 devstack sudo[109263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1
Aug 12 16:32:07 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:07 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" returned: 0 in 0.248s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:32:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce94fba6-69e9-48a8-8925-330bd74a6053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a92b285-f10b-4264-8765-ef2ed49230e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:07 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Volume volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1 (3ecafcbb-d66a-4d4c-9bae-801c66207fd1): created successfully
Aug 12 16:32:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a92b285-f10b-4264-8765-ef2ed49230e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Flow 'volume_create_manager' (1fb00208-802f-4279-80d9-8d879c4d792a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:32:07 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-f0e99a9c-e8bd-483f-9c03-c165a4a121fd tempest-SnapshotsActionsTest-1675351312 None] Created volume successfully.
Aug 12 16:32:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6016625b-d8fb-4285-ad14-5efabaf9e893 tempest-SnapshotsActionsTest-1675351312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6016625b-d8fb-4285-ad14-5efabaf9e893 tempest-SnapshotsActionsTest-1675351312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-6016625b-d8fb-4285-ad14-5efabaf9e893 tempest-SnapshotsActionsTest-1675351312 None] Creating offline snapshot 7d8ade92-619c-4e27-941b-b01192bac803 of volume 3ecafcbb-d66a-4d4c-9bae-801c66207fd1 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:32:09 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb16501-7c72-4d8c-bc64-a493915c92f4]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6016625b-d8fb-4285-ad14-5efabaf9e893 tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:09 devstack sudo[109266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1
Aug 12 16:32:09 devstack sudo[109266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:09 devstack sudo[109266]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6016625b-d8fb-4285-ad14-5efabaf9e893 tempest-SnapshotsActionsTest-1675351312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" returned: 0 in 0.406s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6016625b-d8fb-4285-ad14-5efabaf9e893 tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:09 devstack sudo[109271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 1G
Aug 12 16:32:09 devstack sudo[109271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:09 devstack sudo[109271]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6016625b-d8fb-4285-ad14-5efabaf9e893 tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 1G" returned: 0 in 0.405s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6016625b-d8fb-4285-ad14-5efabaf9e893 tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:10 devstack sudo[109278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803
Aug 12 16:32:10 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:10 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6016625b-d8fb-4285-ad14-5efabaf9e893 tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803" returned: 0 in 0.344s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:10 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-6016625b-d8fb-4285-ad14-5efabaf9e893 tempest-SnapshotsActionsTest-1675351312 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 is being set with open permissions: ugo+rw
Aug 12 16:32:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6016625b-d8fb-4285-ad14-5efabaf9e893 tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:10 devstack sudo[109285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803
Aug 12 16:32:10 devstack sudo[109285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:10 devstack sudo[109285]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6016625b-d8fb-4285-ad14-5efabaf9e893 tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803" returned: 0 in 0.248s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6016625b-d8fb-4285-ad14-5efabaf9e893 tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:10 devstack sudo[109288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.info
Aug 12 16:32:10 devstack sudo[109288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:10 devstack sudo[109288]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6016625b-d8fb-4285-ad14-5efabaf9e893 tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.info" returned: 0 in 0.278s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:10 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-6016625b-d8fb-4285-ad14-5efabaf9e893 tempest-SnapshotsActionsTest-1675351312 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.info is being set with open permissions: ugo+rw
Aug 12 16:32:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6016625b-d8fb-4285-ad14-5efabaf9e893 tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:10 devstack sudo[109291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.info
Aug 12 16:32:10 devstack sudo[109291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:11 devstack sudo[109291]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6016625b-d8fb-4285-ad14-5efabaf9e893 tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.info" returned: 0 in 0.268s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6016625b-d8fb-4285-ad14-5efabaf9e893 tempest-SnapshotsActionsTest-1675351312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.056s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:11 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-6016625b-d8fb-4285-ad14-5efabaf9e893 tempest-SnapshotsActionsTest-1675351312 None] Create snapshot completed successfully
Aug 12 16:32:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-437ad019-009d-498e-9106-621245b9e568 tempest-SnapshotsActionsTest-1675351312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-437ad019-009d-498e-9106-621245b9e568 tempest-SnapshotsActionsTest-1675351312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-437ad019-009d-498e-9106-621245b9e568 tempest-SnapshotsActionsTest-1675351312 None] Creating offline snapshot 4830caa5-eed1-4181-a9e8-8964bf4d4355 of volume 3ecafcbb-d66a-4d4c-9bae-801c66207fd1 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:32:12 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[958f6ac9-74a1-4edc-9f2c-ac9bcd550b1e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-437ad019-009d-498e-9106-621245b9e568 tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:13 devstack sudo[109296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803
Aug 12 16:32:13 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:13 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-437ad019-009d-498e-9106-621245b9e568 tempest-SnapshotsActionsTest-1675351312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803" returned: 0 in 0.467s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-437ad019-009d-498e-9106-621245b9e568 tempest-SnapshotsActionsTest-1675351312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:32:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-437ad019-009d-498e-9106-621245b9e568 tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:13 devstack sudo[109312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355 1G
Aug 12 16:32:13 devstack sudo[109312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:14 devstack sudo[109312]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-437ad019-009d-498e-9106-621245b9e568 tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355 1G" returned: 0 in 0.699s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-437ad019-009d-498e-9106-621245b9e568 tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:14 devstack sudo[109319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355
Aug 12 16:32:14 devstack sudo[109319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:14 devstack sudo[109319]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-437ad019-009d-498e-9106-621245b9e568 tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355" returned: 0 in 0.379s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:14 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-437ad019-009d-498e-9106-621245b9e568 tempest-SnapshotsActionsTest-1675351312 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355 is being set with open permissions: ugo+rw
Aug 12 16:32:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-437ad019-009d-498e-9106-621245b9e568 tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:14 devstack sudo[109331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355
Aug 12 16:32:14 devstack sudo[109331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:14 devstack sudo[109331]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-437ad019-009d-498e-9106-621245b9e568 tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355" returned: 0 in 0.290s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-437ad019-009d-498e-9106-621245b9e568 tempest-SnapshotsActionsTest-1675351312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.958s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:14 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-437ad019-009d-498e-9106-621245b9e568 tempest-SnapshotsActionsTest-1675351312 None] Create snapshot completed successfully
Aug 12 16:32:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] Acquiring lock "cinder-4830caa5-eed1-4181-a9e8-8964bf4d4355-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-4830caa5-eed1-4181-a9e8-8964bf4d4355-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] Acquiring lock "cinder-quobyte-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-quobyte-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] Acquiring lock "cinder-quobyte-4830caa5-eed1-4181-a9e8-8964bf4d4355" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-quobyte-4830caa5-eed1-4181-a9e8-8964bf4d4355" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] Deleting offline snapshot 4830caa5-eed1-4181-a9e8-8964bf4d4355 of volume 3ecafcbb-d66a-4d4c-9bae-801c66207fd1 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:32:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] snapshot_file for this snap is: volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:32:15 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b418190-91d4-4495-82d2-7c48f4e3f639]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:15 devstack sudo[109334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355
Aug 12 16:32:15 devstack sudo[109334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:15 devstack sudo[109334]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355" returned: 0 in 0.426s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:32:15 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9962ca-d9ed-4af7-a6f6-848427e60115]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:15 devstack sudo[109340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803
Aug 12 16:32:15 devstack sudo[109340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:16 devstack sudo[109340]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803" returned: 0 in 0.606s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:16 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:32:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:16 devstack sudo[109361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355
Aug 12 16:32:16 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:16 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-bac5967b-273c-4d5b-a8f0-9dee5177f663 req-c01dd2a9-5a4a-42ad-927b-fbca6d9ee6fd tempest-TestShelveInstance-1732532078 None] Terminate volume connection completed successfully.
Aug 12 16:32:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-bac5967b-273c-4d5b-a8f0-9dee5177f663 req-c01dd2a9-5a4a-42ad-927b-fbca6d9ee6fd tempest-TestShelveInstance-1732532078 None] Deleting attachment 96e84b1b-62c9-45ef-9cda-7c7332f4535c. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:32:16 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355" returned: 0 in 0.600s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:16 devstack sudo[109368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355
Aug 12 16:32:16 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:17 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.4830caa5-eed1-4181-a9e8-8964bf4d4355" returned: 0 in 0.337s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-quobyte-4830caa5-eed1-4181-a9e8-8964bf4d4355" released by "_delete_snapshot" :: held 2.112s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-quobyte-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" released by "delete_snapshot" :: held 2.140s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:17 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] Created reservations ['c332fd60-0543-4353-a9b3-ce00d14827f8', '39fabe63-08bf-4e80-aba7-905b94a631ef', '0a3cb0a5-6501-4122-b4d7-6911a3b9def9', '98084b64-4362-4367-9260-312367a38c09'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:32:17 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] Delete snapshot completed successfully.
Aug 12 16:32:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6663c797-ca65-4074-a722-6de5a285aab5 tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-4830caa5-eed1-4181-a9e8-8964bf4d4355-delete_snapshot" released by "delete_snapshot" :: held 2.334s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3eb37dd2-2fb8-4e2a-9e3f-1e2c11a9a278 tempest-SnapshotsActionsTest-1675351312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3eb37dd2-2fb8-4e2a-9e3f-1e2c11a9a278 tempest-SnapshotsActionsTest-1675351312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-3eb37dd2-2fb8-4e2a-9e3f-1e2c11a9a278 tempest-SnapshotsActionsTest-1675351312 None] Creating offline snapshot 1748c8cd-561d-4fe3-acc1-7794d581ca85 of volume 3ecafcbb-d66a-4d4c-9bae-801c66207fd1 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:32:18 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2786eb-5edf-48f5-ad45-097abea0b3f4]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3eb37dd2-2fb8-4e2a-9e3f-1e2c11a9a278 tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-057ee8ef-b426-4440-9f90-fe5256f82feb req-c3cc4ff4-1b5b-40de-ac68-2b20f71c87cc tempest-TestShelveInstance-1732532078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:19 devstack sudo[109385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803
Aug 12 16:32:19 devstack sudo[109385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:19 devstack sudo[109385]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3eb37dd2-2fb8-4e2a-9e3f-1e2c11a9a278 tempest-SnapshotsActionsTest-1675351312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803" returned: 0 in 0.420s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-3eb37dd2-2fb8-4e2a-9e3f-1e2c11a9a278 tempest-SnapshotsActionsTest-1675351312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:32:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3eb37dd2-2fb8-4e2a-9e3f-1e2c11a9a278 tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:19 devstack sudo[109390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85 1G
Aug 12 16:32:19 devstack sudo[109390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:32:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:32:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:32:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:19 devstack sudo[109392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:32:19 devstack sudo[109392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:19 devstack sudo[109392]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.331s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:32:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:32:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 29 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:32:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>, <Thread(Rabbit-heartbeat, started daemon 134532925736384)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:32:19 devstack sudo[109390]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3eb37dd2-2fb8-4e2a-9e3f-1e2c11a9a278 tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85 1G" returned: 0 in 0.578s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3eb37dd2-2fb8-4e2a-9e3f-1e2c11a9a278 tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:19 devstack sudo[109400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85
Aug 12 16:32:19 devstack sudo[109400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:20 devstack sudo[109400]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3eb37dd2-2fb8-4e2a-9e3f-1e2c11a9a278 tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85" returned: 0 in 0.367s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:20 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-3eb37dd2-2fb8-4e2a-9e3f-1e2c11a9a278 tempest-SnapshotsActionsTest-1675351312 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85 is being set with open permissions: ugo+rw
Aug 12 16:32:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3eb37dd2-2fb8-4e2a-9e3f-1e2c11a9a278 tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:20 devstack sudo[109415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85
Aug 12 16:32:20 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:20 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3eb37dd2-2fb8-4e2a-9e3f-1e2c11a9a278 tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85" returned: 0 in 0.358s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3eb37dd2-2fb8-4e2a-9e3f-1e2c11a9a278 tempest-SnapshotsActionsTest-1675351312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.850s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-057ee8ef-b426-4440-9f90-fe5256f82feb req-c3cc4ff4-1b5b-40de-ac68-2b20f71c87cc tempest-TestShelveInstance-1732532078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.722s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-057ee8ef-b426-4440-9f90-fe5256f82feb req-c3cc4ff4-1b5b-40de-ac68-2b20f71c87cc tempest-TestShelveInstance-1732532078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:20 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-3eb37dd2-2fb8-4e2a-9e3f-1e2c11a9a278 tempest-SnapshotsActionsTest-1675351312 None] Create snapshot completed successfully
Aug 12 16:32:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-057ee8ef-b426-4440-9f90-fe5256f82feb req-c3cc4ff4-1b5b-40de-ac68-2b20f71c87cc tempest-TestShelveInstance-1732532078 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-3902aaa8-1477-41fb-a493-e15a72917659', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6762e1d3-a964-4a4d-98a3-82e4b6a870c2', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:32:20 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-057ee8ef-b426-4440-9f90-fe5256f82feb req-c3cc4ff4-1b5b-40de-ac68-2b20f71c87cc tempest-TestShelveInstance-1732532078 None] attachment_update completed successfully.
Aug 12 16:32:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] Acquiring lock "cinder-1748c8cd-561d-4fe3-acc1-7794d581ca85-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-1748c8cd-561d-4fe3-acc1-7794d581ca85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] Acquiring lock "cinder-quobyte-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-quobyte-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] Acquiring lock "cinder-quobyte-1748c8cd-561d-4fe3-acc1-7794d581ca85" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-quobyte-1748c8cd-561d-4fe3-acc1-7794d581ca85" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] Deleting offline snapshot 1748c8cd-561d-4fe3-acc1-7794d581ca85 of volume 3ecafcbb-d66a-4d4c-9bae-801c66207fd1 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:32:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] snapshot_file for this snap is: volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:32:21 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f72eca0-4c80-4818-b2a8-78f70492dae4]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:21 devstack sudo[109424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85
Aug 12 16:32:21 devstack sudo[109424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:21 devstack sudo[109424]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85" returned: 0 in 0.411s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:32:21 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[b659cc65-2c67-4476-93c5-8f68c2c1b733]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:21 devstack sudo[109431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803
Aug 12 16:32:21 devstack sudo[109431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:22 devstack sudo[109431]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803" returned: 0 in 0.449s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:32:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:22 devstack sudo[109437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85
Aug 12 16:32:22 devstack sudo[109437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:22 devstack sudo[109437]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85" returned: 0 in 0.527s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:22 devstack sudo[109443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85
Aug 12 16:32:22 devstack sudo[109443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:22 devstack sudo[109443]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.1748c8cd-561d-4fe3-acc1-7794d581ca85" returned: 0 in 0.391s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-quobyte-1748c8cd-561d-4fe3-acc1-7794d581ca85" released by "_delete_snapshot" :: held 1.948s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-quobyte-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" released by "delete_snapshot" :: held 1.986s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:23 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] Created reservations ['c1876c64-46c8-4ce6-b486-179ce7283691', 'fb9e8598-de85-4e38-9085-1aa35839d750', 'f7763c30-adf5-4e27-957c-f558755565fc', '1ab9dc1b-edbb-4886-b56e-a2ac679f019a'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:32:23 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] Delete snapshot completed successfully.
Aug 12 16:32:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-87c17c07-7add-4ed8-b8dd-8ac3da2029bd tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-1748c8cd-561d-4fe3-acc1-7794d581ca85-delete_snapshot" released by "delete_snapshot" :: held 2.249s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9eb336da-a16a-45be-9c48-859285ea06a4 tempest-SnapshotsActionsTest-1675351312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9eb336da-a16a-45be-9c48-859285ea06a4 tempest-SnapshotsActionsTest-1675351312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-9eb336da-a16a-45be-9c48-859285ea06a4 tempest-SnapshotsActionsTest-1675351312 None] Creating offline snapshot d495cdf1-47fd-4fd0-9f30-922086ab70a8 of volume 3ecafcbb-d66a-4d4c-9bae-801c66207fd1 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:32:24 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b04d3c8-8c89-47e3-9236-fcf364255ba1]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9eb336da-a16a-45be-9c48-859285ea06a4 tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:24 devstack sudo[109533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803
Aug 12 16:32:24 devstack sudo[109533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:24 devstack sudo[109533]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9eb336da-a16a-45be-9c48-859285ea06a4 tempest-SnapshotsActionsTest-1675351312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803" returned: 0 in 0.813s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-9eb336da-a16a-45be-9c48-859285ea06a4 tempest-SnapshotsActionsTest-1675351312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:32:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9eb336da-a16a-45be-9c48-859285ea06a4 tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:24 devstack sudo[109899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8 1G
Aug 12 16:32:24 devstack sudo[109899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:25 devstack sudo[109899]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9eb336da-a16a-45be-9c48-859285ea06a4 tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8 1G" returned: 0 in 0.885s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9eb336da-a16a-45be-9c48-859285ea06a4 tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:25 devstack sudo[110002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8
Aug 12 16:32:25 devstack sudo[110002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:26 devstack sudo[110002]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9eb336da-a16a-45be-9c48-859285ea06a4 tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8" returned: 0 in 0.527s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:26 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-9eb336da-a16a-45be-9c48-859285ea06a4 tempest-SnapshotsActionsTest-1675351312 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8 is being set with open permissions: ugo+rw
Aug 12 16:32:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9eb336da-a16a-45be-9c48-859285ea06a4 tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:26 devstack sudo[110019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8
Aug 12 16:32:26 devstack sudo[110019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:26 devstack sudo[110019]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9eb336da-a16a-45be-9c48-859285ea06a4 tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8" returned: 0 in 0.325s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9eb336da-a16a-45be-9c48-859285ea06a4 tempest-SnapshotsActionsTest-1675351312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.760s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:26 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-9eb336da-a16a-45be-9c48-859285ea06a4 tempest-SnapshotsActionsTest-1675351312 None] Create snapshot completed successfully
Aug 12 16:32:27 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] Acquiring lock "cinder-d495cdf1-47fd-4fd0-9f30-922086ab70a8-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:27 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-d495cdf1-47fd-4fd0-9f30-922086ab70a8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:27 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] Acquiring lock "cinder-quobyte-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:27 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-quobyte-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:27 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] Acquiring lock "cinder-quobyte-d495cdf1-47fd-4fd0-9f30-922086ab70a8" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:27 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-quobyte-d495cdf1-47fd-4fd0-9f30-922086ab70a8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] Deleting offline snapshot d495cdf1-47fd-4fd0-9f30-922086ab70a8 of volume 3ecafcbb-d66a-4d4c-9bae-801c66207fd1 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:32:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] snapshot_file for this snap is: volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:32:27 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2938d40-d1fc-4243-90f9-95f26fc024f3]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:27 devstack sudo[110037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8
Aug 12 16:32:27 devstack sudo[110037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:27 devstack sudo[110037]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8" returned: 0 in 0.560s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:32:27 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a929dd7-ee5f-48f3-85e7-e5aec4000e70]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:28 devstack sudo[110044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803
Aug 12 16:32:28 devstack sudo[110044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:28 devstack sudo[110044]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803" returned: 0 in 0.641s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:28 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:32:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:28 devstack sudo[110050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8
Aug 12 16:32:28 devstack sudo[110050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:29 devstack sudo[110050]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8" returned: 0 in 0.705s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:29 devstack sudo[110057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8
Aug 12 16:32:29 devstack sudo[110057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:29 devstack sudo[110057]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.d495cdf1-47fd-4fd0-9f30-922086ab70a8" returned: 0 in 0.360s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:29 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-quobyte-d495cdf1-47fd-4fd0-9f30-922086ab70a8" released by "_delete_snapshot" :: held 2.471s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:29 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-quobyte-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" released by "delete_snapshot" :: held 2.510s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:29 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] Created reservations ['c20fd0eb-d481-47fd-b792-1155564168c7', 'dce033f4-2a15-40d6-84f5-7abef1ce10b9', '5fc6bd79-f453-46b2-bc6b-1c4e0ef0aa60', 'edc8855e-8105-4df0-b68e-f8d1737a9245'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:32:29 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] Delete snapshot completed successfully.
Aug 12 16:32:29 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8a68d89-193c-416e-ac27-c83955177b03 tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-d495cdf1-47fd-4fd0-9f30-922086ab70a8-delete_snapshot" released by "delete_snapshot" :: held 2.718s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd234c20-e888-4518-ac50-739aba9aaf0e tempest-SnapshotsActionsTest-1675351312 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd234c20-e888-4518-ac50-739aba9aaf0e tempest-SnapshotsActionsTest-1675351312 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-cd234c20-e888-4518-ac50-739aba9aaf0e tempest-SnapshotsActionsTest-1675351312 None] Creating offline snapshot 8066dee5-7dd1-4e2a-a707-14d59a2fdc14 of volume 3ecafcbb-d66a-4d4c-9bae-801c66207fd1 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:32:30 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a708c75-bf93-4720-a59f-e5f17a7ca770]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd234c20-e888-4518-ac50-739aba9aaf0e tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:31 devstack sudo[110062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803
Aug 12 16:32:31 devstack sudo[110062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:31 devstack sudo[110062]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd234c20-e888-4518-ac50-739aba9aaf0e tempest-SnapshotsActionsTest-1675351312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803" returned: 0 in 0.412s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-cd234c20-e888-4518-ac50-739aba9aaf0e tempest-SnapshotsActionsTest-1675351312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:32:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd234c20-e888-4518-ac50-739aba9aaf0e tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:31 devstack sudo[110067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14 1G
Aug 12 16:32:31 devstack sudo[110067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:31 devstack sudo[110067]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd234c20-e888-4518-ac50-739aba9aaf0e tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14 1G" returned: 0 in 0.477s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd234c20-e888-4518-ac50-739aba9aaf0e tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:31 devstack sudo[110073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14
Aug 12 16:32:31 devstack sudo[110073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:32 devstack sudo[110073]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd234c20-e888-4518-ac50-739aba9aaf0e tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14" returned: 0 in 0.341s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:32 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-cd234c20-e888-4518-ac50-739aba9aaf0e tempest-SnapshotsActionsTest-1675351312 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14 is being set with open permissions: ugo+rw
Aug 12 16:32:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd234c20-e888-4518-ac50-739aba9aaf0e tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:32 devstack sudo[110079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14
Aug 12 16:32:32 devstack sudo[110079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:32 devstack sudo[110079]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd234c20-e888-4518-ac50-739aba9aaf0e tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14" returned: 0 in 0.271s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd234c20-e888-4518-ac50-739aba9aaf0e tempest-SnapshotsActionsTest-1675351312 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.611s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:32 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-cd234c20-e888-4518-ac50-739aba9aaf0e tempest-SnapshotsActionsTest-1675351312 None] Create snapshot completed successfully
Aug 12 16:32:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] Acquiring lock "cinder-8066dee5-7dd1-4e2a-a707-14d59a2fdc14-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-8066dee5-7dd1-4e2a-a707-14d59a2fdc14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] Acquiring lock "cinder-quobyte-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-quobyte-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] Acquiring lock "cinder-quobyte-8066dee5-7dd1-4e2a-a707-14d59a2fdc14" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-quobyte-8066dee5-7dd1-4e2a-a707-14d59a2fdc14" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] Deleting offline snapshot 8066dee5-7dd1-4e2a-a707-14d59a2fdc14 of volume 3ecafcbb-d66a-4d4c-9bae-801c66207fd1 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:32:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] snapshot_file for this snap is: volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:32:33 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[642cdf49-eda4-482a-915d-0777fc75ca16]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:33 devstack sudo[110085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14
Aug 12 16:32:33 devstack sudo[110085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:33 devstack sudo[110085]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14" returned: 0 in 0.379s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:32:33 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ddd54f-747f-4aa7-ae66-2d29c868c360]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:33 devstack sudo[110093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803
Aug 12 16:32:33 devstack sudo[110093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:33 devstack sudo[110093]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803" returned: 0 in 0.380s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:32:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:34 devstack sudo[110098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14
Aug 12 16:32:34 devstack sudo[110098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:34 devstack sudo[110098]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14" returned: 0 in 0.380s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:34 devstack sudo[110103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14
Aug 12 16:32:34 devstack sudo[110103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:34 devstack sudo[110103]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.8066dee5-7dd1-4e2a-a707-14d59a2fdc14" returned: 0 in 0.239s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-quobyte-8066dee5-7dd1-4e2a-a707-14d59a2fdc14" released by "_delete_snapshot" :: held 1.502s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-quobyte-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" released by "delete_snapshot" :: held 1.531s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:34 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] Created reservations ['cfbe564e-3f40-4974-af98-3e78a8d98a48', 'cac38281-1279-49c4-bc45-64696ad6e2ed', 'a2ff5a4a-7736-4dd1-9ed3-8b1b450e3f4f', 'f9e03bcf-7d73-4fb9-a500-dd6447d42997'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:32:34 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] Delete snapshot completed successfully.
Aug 12 16:32:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e7d2d2ac-d28f-4e41-8f6e-17e9c048225b tempest-SnapshotsActionsTest-1902623582 None] Lock "cinder-8066dee5-7dd1-4e2a-a707-14d59a2fdc14-delete_snapshot" released by "delete_snapshot" :: held 1.693s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] Acquiring lock "cinder-7d8ade92-619c-4e27-941b-b01192bac803-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] Lock "cinder-7d8ade92-619c-4e27-941b-b01192bac803-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] Acquiring lock "cinder-quobyte-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] Lock "cinder-quobyte-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] Acquiring lock "cinder-quobyte-7d8ade92-619c-4e27-941b-b01192bac803" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] Lock "cinder-quobyte-7d8ade92-619c-4e27-941b-b01192bac803" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] Deleting offline snapshot 7d8ade92-619c-4e27-941b-b01192bac803 of volume 3ecafcbb-d66a-4d4c-9bae-801c66207fd1 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:32:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] snapshot_file for this snap is: volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:32:35 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85e6679-d6e4-4499-8210-995bd0807e89]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:35 devstack sudo[110106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803
Aug 12 16:32:35 devstack sudo[110106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:36 devstack sudo[110106]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803" returned: 0 in 0.405s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:32:36 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fde14d-9d02-4a52-855c-3e22b8a206f3]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:36 devstack sudo[110111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1
Aug 12 16:32:36 devstack sudo[110111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:36 devstack sudo[110111]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" returned: 0 in 0.368s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:36 devstack sudo[110116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803
Aug 12 16:32:36 devstack sudo[110116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:36 devstack sudo[110116]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803" returned: 0 in 0.344s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:36 devstack sudo[110121]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803
Aug 12 16:32:36 devstack sudo[110121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:37 devstack sudo[110121]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1.7d8ade92-619c-4e27-941b-b01192bac803" returned: 0 in 0.250s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] Lock "cinder-quobyte-7d8ade92-619c-4e27-941b-b01192bac803" released by "_delete_snapshot" :: held 1.475s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] Lock "cinder-quobyte-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" released by "delete_snapshot" :: held 1.503s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:37 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] Created reservations ['0a2b1f27-d136-40fe-989b-facd940e2564', '49fb0ede-9aba-4471-b10b-207143fd9e3c', 'c3294cee-a880-4c92-b8eb-f17c33d27397', 'd4c8af41-4b02-4515-96b8-0aa6c4753eb8'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:32:37 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] Delete snapshot completed successfully.
Aug 12 16:32:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-21d17812-824d-4095-96bb-d6e5fef1807e tempest-SnapshotsActionsTest-1675351312 None] Lock "cinder-7d8ade92-619c-4e27-941b-b01192bac803-delete_snapshot" released by "delete_snapshot" :: held 1.657s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] Acquiring lock "cinder-3ecafcbb-d66a-4d4c-9bae-801c66207fd1-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] Lock "cinder-3ecafcbb-d66a-4d4c-9bae-801c66207fd1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] Acquiring lock "cinder-quobyte-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] Lock "cinder-quobyte-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" acquired by "delete_volume" :: waited 0.019s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:38 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28fd13a-4798-4ba5-83d8-0865b79069cd]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:38 devstack sudo[110125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1
Aug 12 16:32:38 devstack sudo[110125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:38 devstack sudo[110125]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" returned: 0 in 0.380s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:38 devstack sudo[110131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1
Aug 12 16:32:38 devstack sudo[110131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:38 devstack sudo[110131]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" returned: 0 in 0.251s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] Lock "cinder-quobyte-3ecafcbb-d66a-4d4c-9bae-801c66207fd1" released by "delete_volume" :: held 0.695s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:38 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] Created reservations ['753600f6-a8e5-4838-afef-b1ed05408b5a', '9e997c9e-f01f-4866-bc7c-cb9992906916', '420a0fe9-69ee-4436-8a59-d48784606eb7', 'df426a41-714d-4c8b-8ea2-6c4310e0b738'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:32:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:32:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:32:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:38 devstack sudo[110137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:32:38 devstack sudo[110137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:39 devstack sudo[110137]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.346s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:39 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:32:39 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] Deleted volume successfully.
Aug 12 16:32:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0e434fa0-a3b0-4a5f-9631-a27043edce9b tempest-SnapshotsActionsTest-1675351312 None] Lock "cinder-3ecafcbb-d66a-4d4c-9bae-801c66207fd1-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Flow 'volume_create_manager' (5702587e-ca2d-4b53-af3d-0046acb4b6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7974bd8b-f621-4ed7-80e8-4afcf461d000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7974bd8b-f621-4ed7-80e8-4afcf461d000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-784460048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a9c6631-2ee8-45fc-95aa-b5b1bed495c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29156e01b10c46958968ae4312a24cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:32:44Z,use_quota=True,user_id='1b3fad39608a4c1aa6b3eeeda628ffab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d09e302-1c26-4b45-b1ec-f57c8e7246f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d09e302-1c26-4b45-b1ec-f57c8e7246f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d64caf-a74c-42c1-87bd-37fabc2957ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d64caf-a74c-42c1-87bd-37fabc2957ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a9c6631-2ee8-45fc-95aa-b5b1bed495c6', 'volume_name': 'volume-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3939da6-3e2d-45ff-b2c7-ee9659fb480f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3939da6-3e2d-45ff-b2c7-ee9659fb480f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf63338-3841-45a7-85cd-4dbde3f18d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:44 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Volume 1a9c6631-2ee8-45fc-95aa-b5b1bed495c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6', 'volume_size': 1}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-784460048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a9c6631-2ee8-45fc-95aa-b5b1bed495c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29156e01b10c46958968ae4312a24cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:32:44Z,use_quota=True,user_id='1b3fad39608a4c1aa6b3eeeda628ffab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Creating volume 1a9c6631-2ee8-45fc-95aa-b5b1bed495c6 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:32:44 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:44 devstack sudo[110191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6 1073741824
Aug 12 16:32:44 devstack sudo[110191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:44 devstack sudo[110191]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6 1073741824" returned: 0 in 0.409s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:44 devstack sudo[110196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6
Aug 12 16:32:44 devstack sudo[110196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:44 devstack sudo[110196]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6" returned: 0 in 0.250s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf63338-3841-45a7-85cd-4dbde3f18d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552e1a6a-9dc0-4e08-873e-f9114477848c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:44 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Volume volume-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6 (1a9c6631-2ee8-45fc-95aa-b5b1bed495c6): created successfully
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552e1a6a-9dc0-4e08-873e-f9114477848c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Flow 'volume_create_manager' (5702587e-ca2d-4b53-af3d-0046acb4b6d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:32:45 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c8ed731e-e35b-40a1-90e9-11052182250a tempest-VolumesListAdminTestJSON-1083287031 None] Created volume successfully.
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Flow 'volume_create_manager' (0f83dc88-ba04-4550-ae49-5e55bff967c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285fd6c7-380b-407b-bc4b-e7107081e1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285fd6c7-380b-407b-bc4b-e7107081e1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1574388221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7afbc077-171c-40ef-adc3-2e6a66059343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29156e01b10c46958968ae4312a24cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:32:46Z,use_quota=True,user_id='1b3fad39608a4c1aa6b3eeeda628ffab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356d56c6-0693-4ecc-98e5-3495764b44fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356d56c6-0693-4ecc-98e5-3495764b44fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64699248-33e3-4b36-961e-0424d0389afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64699248-33e3-4b36-961e-0424d0389afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7afbc077-171c-40ef-adc3-2e6a66059343', 'volume_name': 'volume-7afbc077-171c-40ef-adc3-2e6a66059343', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468d737f-4499-4ccd-b2b6-e1082553644d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (468d737f-4499-4ccd-b2b6-e1082553644d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (921392f9-6686-475f-8efe-9f6c9d9bc178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:45 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Volume 7afbc077-171c-40ef-adc3-2e6a66059343: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7afbc077-171c-40ef-adc3-2e6a66059343', 'volume_size': 1}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1574388221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7afbc077-171c-40ef-adc3-2e6a66059343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29156e01b10c46958968ae4312a24cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:32:46Z,use_quota=True,user_id='1b3fad39608a4c1aa6b3eeeda628ffab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Creating volume 7afbc077-171c-40ef-adc3-2e6a66059343 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:32:45 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:32:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7afbc077-171c-40ef-adc3-2e6a66059343 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:45 devstack sudo[110199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7afbc077-171c-40ef-adc3-2e6a66059343 1073741824
Aug 12 16:32:45 devstack sudo[110199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:46 devstack sudo[110199]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7afbc077-171c-40ef-adc3-2e6a66059343 1073741824" returned: 0 in 0.431s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7afbc077-171c-40ef-adc3-2e6a66059343 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:46 devstack sudo[110204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7afbc077-171c-40ef-adc3-2e6a66059343
Aug 12 16:32:46 devstack sudo[110204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:46 devstack sudo[110204]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7afbc077-171c-40ef-adc3-2e6a66059343" returned: 0 in 0.247s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:32:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (921392f9-6686-475f-8efe-9f6c9d9bc178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7afbc077-171c-40ef-adc3-2e6a66059343', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce2e1af-4eea-474f-8aaa-408dac522623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:46 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Volume volume-7afbc077-171c-40ef-adc3-2e6a66059343 (7afbc077-171c-40ef-adc3-2e6a66059343): created successfully
Aug 12 16:32:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce2e1af-4eea-474f-8aaa-408dac522623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Flow 'volume_create_manager' (0f83dc88-ba04-4550-ae49-5e55bff967c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:32:46 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-07648ea9-b69b-4379-bb8a-7fa2c3e76854 tempest-VolumesListAdminTestJSON-1083287031 None] Created volume successfully.
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Flow 'volume_create_manager' (ce95883c-453c-4c5f-9d4c-c9d788f58f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380952de-dd12-4342-941e-6b112ac6e18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (380952de-dd12-4342-941e-6b112ac6e18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1055179993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1482086c-8bc9-47e1-a337-9dcabf4e3df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29156e01b10c46958968ae4312a24cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:32:47Z,use_quota=True,user_id='1b3fad39608a4c1aa6b3eeeda628ffab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554a8abb-c084-41a8-81da-1c7b59ac53ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (554a8abb-c084-41a8-81da-1c7b59ac53ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1710d1a-64c2-4ed1-aeb0-03048d3aa063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1710d1a-64c2-4ed1-aeb0-03048d3aa063) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1482086c-8bc9-47e1-a337-9dcabf4e3df9', 'volume_name': 'volume-1482086c-8bc9-47e1-a337-9dcabf4e3df9', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d2dbc7-3021-4689-91ac-10e9cbcde653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d2dbc7-3021-4689-91ac-10e9cbcde653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8175be-08bd-4dff-9cf8-376caca34d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:47 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Volume 1482086c-8bc9-47e1-a337-9dcabf4e3df9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1482086c-8bc9-47e1-a337-9dcabf4e3df9', 'volume_size': 1}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1055179993',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1482086c-8bc9-47e1-a337-9dcabf4e3df9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29156e01b10c46958968ae4312a24cda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:32:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:32:47Z,use_quota=True,user_id='1b3fad39608a4c1aa6b3eeeda628ffab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Creating volume 1482086c-8bc9-47e1-a337-9dcabf4e3df9 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:32:47 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1482086c-8bc9-47e1-a337-9dcabf4e3df9 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:47 devstack sudo[110207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1482086c-8bc9-47e1-a337-9dcabf4e3df9 1073741824
Aug 12 16:32:47 devstack sudo[110207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:47 devstack sudo[110207]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1482086c-8bc9-47e1-a337-9dcabf4e3df9 1073741824" returned: 0 in 0.411s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1482086c-8bc9-47e1-a337-9dcabf4e3df9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:47 devstack sudo[110213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1482086c-8bc9-47e1-a337-9dcabf4e3df9
Aug 12 16:32:47 devstack sudo[110213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:47 devstack sudo[110213]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1482086c-8bc9-47e1-a337-9dcabf4e3df9" returned: 0 in 0.247s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8175be-08bd-4dff-9cf8-376caca34d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1482086c-8bc9-47e1-a337-9dcabf4e3df9', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f438715f-4ba2-4efa-8f6b-3e81a84f08f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:48 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Volume volume-1482086c-8bc9-47e1-a337-9dcabf4e3df9 (1482086c-8bc9-47e1-a337-9dcabf4e3df9): created successfully
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f438715f-4ba2-4efa-8f6b-3e81a84f08f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Flow 'volume_create_manager' (ce95883c-453c-4c5f-9d4c-c9d788f58f6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:32:48 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5df43184-6384-481b-b96e-6b086dd3fa5d tempest-VolumesListAdminTestJSON-1083287031 None] Created volume successfully.
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Flow 'volume_create_manager' (0ca78779-e3a2-4a25-938c-0068cb8469f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a05ba3-dbff-4bf0-9d3f-4b3278e639c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a05ba3-dbff-4bf0-9d3f-4b3278e639c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efcae331-5eec-4322-91fd-ed89753813d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286db9197c574fd6a9257c6e90aac3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:32:49Z,use_quota=True,user_id='3a57dfe0931e4989a66c2c01a86b33e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ec450c-a9fd-4b6a-b82d-85d8ffddbedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ec450c-a9fd-4b6a-b82d-85d8ffddbedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da28a320-d775-4223-8709-26e9180fc134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da28a320-d775-4223-8709-26e9180fc134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efcae331-5eec-4322-91fd-ed89753813d2', 'volume_name': 'volume-efcae331-5eec-4322-91fd-ed89753813d2', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57ab7f6-09e0-4a9b-b555-f872c65f3f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57ab7f6-09e0-4a9b-b555-f872c65f3f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b6a61a-6133-4b9b-9aec-066e2c5e1820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:48 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Volume efcae331-5eec-4322-91fd-ed89753813d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efcae331-5eec-4322-91fd-ed89753813d2', 'volume_size': 1}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efcae331-5eec-4322-91fd-ed89753813d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='286db9197c574fd6a9257c6e90aac3b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:32:49Z,use_quota=True,user_id='3a57dfe0931e4989a66c2c01a86b33e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Creating volume efcae331-5eec-4322-91fd-ed89753813d2 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:32:48 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:32:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-efcae331-5eec-4322-91fd-ed89753813d2 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:48 devstack sudo[110218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-efcae331-5eec-4322-91fd-ed89753813d2 1073741824
Aug 12 16:32:48 devstack sudo[110218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:49 devstack sudo[110218]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-efcae331-5eec-4322-91fd-ed89753813d2 1073741824" returned: 0 in 0.439s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-efcae331-5eec-4322-91fd-ed89753813d2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:49 devstack sudo[110224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-efcae331-5eec-4322-91fd-ed89753813d2
Aug 12 16:32:49 devstack sudo[110224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:49 devstack sudo[110224]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-efcae331-5eec-4322-91fd-ed89753813d2" returned: 0 in 0.258s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:32:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b6a61a-6133-4b9b-9aec-066e2c5e1820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efcae331-5eec-4322-91fd-ed89753813d2', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fbbff1-444a-4630-a37f-170165551d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:49 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Volume volume-efcae331-5eec-4322-91fd-ed89753813d2 (efcae331-5eec-4322-91fd-ed89753813d2): created successfully
Aug 12 16:32:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2fbbff1-444a-4630-a37f-170165551d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Flow 'volume_create_manager' (0ca78779-e3a2-4a25-938c-0068cb8469f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:32:49 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-8158bb5b-1d36-4895-bfbc-fb86028d155e tempest-VolumesListAdminTestJSON-14692288 None] Created volume successfully.
Aug 12 16:32:49 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:32:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Flow 'volume_create_manager' (860748ef-f633-460a-8aa8-ff5056b62030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:32:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5e754b-fb99-4e6a-a887-eae34226e5b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:49 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] Acquiring lock "cinder-efcae331-5eec-4322-91fd-ed89753813d2-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d5e754b-fb99-4e6a-a887-eae34226e5b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1410433114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1ccc4f-dc8d-46c0-b77b-fa8983895309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887b82f7728845d298c8055d3acf3abf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:32:50Z,use_quota=True,user_id='17964468ca914d099083acaa5712c7f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0467ad6-6f4e-4e03-9c9f-372f9ae15316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0467ad6-6f4e-4e03-9c9f-372f9ae15316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4102f48-07a6-479c-9ac5-648e3a4a5e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4102f48-07a6-479c-9ac5-648e3a4a5e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae1ccc4f-dc8d-46c0-b77b-fa8983895309', 'volume_name': 'volume-ae1ccc4f-dc8d-46c0-b77b-fa8983895309', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5cd27af-33b3-4476-9f94-c84a0ae70fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5cd27af-33b3-4476-9f94-c84a0ae70fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37ea4ea-9488-4625-aa53-e968dc8d3b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:50 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Volume ae1ccc4f-dc8d-46c0-b77b-fa8983895309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae1ccc4f-dc8d-46c0-b77b-fa8983895309', 'volume_size': 1}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1410433114',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1ccc4f-dc8d-46c0-b77b-fa8983895309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887b82f7728845d298c8055d3acf3abf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:32:50Z,use_quota=True,user_id='17964468ca914d099083acaa5712c7f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Creating volume ae1ccc4f-dc8d-46c0-b77b-fa8983895309 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:32:50 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ae1ccc4f-dc8d-46c0-b77b-fa8983895309 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] Lock "cinder-efcae331-5eec-4322-91fd-ed89753813d2-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:50 devstack sudo[110227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ae1ccc4f-dc8d-46c0-b77b-fa8983895309 1073741824
Aug 12 16:32:50 devstack sudo[110227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] Acquiring lock "cinder-1482086c-8bc9-47e1-a337-9dcabf4e3df9-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] Acquiring lock "cinder-quobyte-efcae331-5eec-4322-91fd-ed89753813d2" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] Lock "cinder-1482086c-8bc9-47e1-a337-9dcabf4e3df9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] Lock "cinder-quobyte-efcae331-5eec-4322-91fd-ed89753813d2" acquired by "delete_volume" :: waited 0.036s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[169b125b-decf-4df5-b838-98ba7a565874]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-efcae331-5eec-4322-91fd-ed89753813d2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] Acquiring lock "cinder-quobyte-1482086c-8bc9-47e1-a337-9dcabf4e3df9" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] Lock "cinder-quobyte-1482086c-8bc9-47e1-a337-9dcabf4e3df9" acquired by "delete_volume" :: waited 0.029s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[da20356c-9fc9-4cdf-a3f5-92d24c0dc1a0]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1482086c-8bc9-47e1-a337-9dcabf4e3df9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:50 devstack sudo[110230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-efcae331-5eec-4322-91fd-ed89753813d2
Aug 12 16:32:50 devstack sudo[110230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:50 devstack sudo[110231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1482086c-8bc9-47e1-a337-9dcabf4e3df9
Aug 12 16:32:50 devstack sudo[110231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:50 devstack sudo[110230]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-efcae331-5eec-4322-91fd-ed89753813d2" returned: 0 in 0.460s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-efcae331-5eec-4322-91fd-ed89753813d2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:50 devstack sudo[110227]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ae1ccc4f-dc8d-46c0-b77b-fa8983895309 1073741824" returned: 0 in 0.678s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:50 devstack sudo[110244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-efcae331-5eec-4322-91fd-ed89753813d2
Aug 12 16:32:50 devstack sudo[110244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ae1ccc4f-dc8d-46c0-b77b-fa8983895309 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:50 devstack sudo[110231]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1482086c-8bc9-47e1-a337-9dcabf4e3df9" returned: 0 in 0.447s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1482086c-8bc9-47e1-a337-9dcabf4e3df9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:50 devstack sudo[110247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ae1ccc4f-dc8d-46c0-b77b-fa8983895309
Aug 12 16:32:50 devstack sudo[110247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:50 devstack sudo[110248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1482086c-8bc9-47e1-a337-9dcabf4e3df9
Aug 12 16:32:50 devstack sudo[110248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:50 devstack sudo[110244]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-efcae331-5eec-4322-91fd-ed89753813d2" returned: 0 in 0.302s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] Lock "cinder-quobyte-efcae331-5eec-4322-91fd-ed89753813d2" released by "delete_volume" :: held 0.860s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:51 devstack sudo[110247]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ae1ccc4f-dc8d-46c0-b77b-fa8983895309" returned: 0 in 0.303s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:51 devstack sudo[110248]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37ea4ea-9488-4625-aa53-e968dc8d3b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae1ccc4f-dc8d-46c0-b77b-fa8983895309', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62bf99c3-6f4e-4694-982c-fb44343fd695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1482086c-8bc9-47e1-a337-9dcabf4e3df9" returned: 0 in 0.327s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:51 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Volume volume-ae1ccc4f-dc8d-46c0-b77b-fa8983895309 (ae1ccc4f-dc8d-46c0-b77b-fa8983895309): created successfully
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62bf99c3-6f4e-4694-982c-fb44343fd695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Flow 'volume_create_manager' (860748ef-f633-460a-8aa8-ff5056b62030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] Lock "cinder-quobyte-1482086c-8bc9-47e1-a337-9dcabf4e3df9" released by "delete_volume" :: held 0.838s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] Created reservations ['a5c40012-e706-4f58-b5e3-749182960d4e', '6ea7ec34-d36e-4231-b114-41ef80ebf3eb', '55de9439-1686-4cc2-9af5-753764ed3c3a', '155aefe6-b7dd-4b85-83f0-072978f8f987'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:32:51 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-8a6ff784-0433-40a9-9121-87ecfad5ee8f tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Created volume successfully.
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:51 devstack sudo[110254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] Created reservations ['b2c3cacf-29fc-4c3e-b95f-e44936012905', 'e751ed54-83bc-4e27-8b2e-b2ad86ba840e', '3cc9efcc-0e65-4709-84ac-87c176830a1a', '43c78f81-bb0d-4c19-a00c-a03708e679ce'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:32:51 devstack sudo[110254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:51 devstack sudo[110256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:32:51 devstack sudo[110256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:51 devstack sudo[110254]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.306s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:32:51 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] Deleted volume successfully.
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a59b53d0-2c53-4242-83f6-c30e30c09a9b tempest-VolumesListAdminTestJSON-14692288 None] Lock "cinder-efcae331-5eec-4322-91fd-ed89753813d2-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:51 devstack sudo[110256]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.269s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:32:51 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] Deleted volume successfully.
Aug 12 16:32:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e3ab3b5d-fdf3-4a6c-b27d-1b595efe896a tempest-VolumesListAdminTestJSON-1083287031 None] Lock "cinder-1482086c-8bc9-47e1-a337-9dcabf4e3df9-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:52 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] Acquiring lock "cinder-7afbc077-171c-40ef-adc3-2e6a66059343-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:52 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] Lock "cinder-7afbc077-171c-40ef-adc3-2e6a66059343-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:52 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=78,cinder:UPDATE=72,cinder:DELETE=9,cinder:INSERT=19 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:32:52 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=80,cinder:UPDATE=90,cinder:INSERT=21,cinder:DELETE=5 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:32:52 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] Acquiring lock "cinder-quobyte-7afbc077-171c-40ef-adc3-2e6a66059343" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:52 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] Lock "cinder-quobyte-7afbc077-171c-40ef-adc3-2e6a66059343" acquired by "delete_volume" :: waited 0.019s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:52 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[138a8b24-ba74-4033-be23-dc4b816d7ccf]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7afbc077-171c-40ef-adc3-2e6a66059343 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:52 devstack sudo[110263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7afbc077-171c-40ef-adc3-2e6a66059343
Aug 12 16:32:52 devstack sudo[110263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-878f87ec-7a7b-41ef-8525-181c755220a3 req-ac9d6b24-0943-4d85-9b59-317837b20a78 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-878f87ec-7a7b-41ef-8525-181c755220a3 req-ac9d6b24-0943-4d85-9b59-317837b20a78 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-878f87ec-7a7b-41ef-8525-181c755220a3 req-ac9d6b24-0943-4d85-9b59-317837b20a78 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:52 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-878f87ec-7a7b-41ef-8525-181c755220a3 req-ac9d6b24-0943-4d85-9b59-317837b20a78 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-ae1ccc4f-dc8d-46c0-b77b-fa8983895309', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a25ab51c-a82f-4e49-9e5f-d70d2686b959', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:32:52 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-878f87ec-7a7b-41ef-8525-181c755220a3 req-ac9d6b24-0943-4d85-9b59-317837b20a78 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] attachment_update completed successfully.
Aug 12 16:32:52 devstack sudo[110263]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7afbc077-171c-40ef-adc3-2e6a66059343" returned: 0 in 0.364s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7afbc077-171c-40ef-adc3-2e6a66059343 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:52 devstack sudo[110276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7afbc077-171c-40ef-adc3-2e6a66059343
Aug 12 16:32:52 devstack sudo[110276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:53 devstack sudo[110276]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7afbc077-171c-40ef-adc3-2e6a66059343" returned: 0 in 0.256s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] Lock "cinder-quobyte-7afbc077-171c-40ef-adc3-2e6a66059343" released by "delete_volume" :: held 0.663s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:53 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] Created reservations ['b244d8ed-1fc7-406d-9a7e-62d9af131ff6', 'cc1670b8-530c-412a-9095-3d4a491ba4f6', 'a41d5755-640b-47b5-87c6-aa2da7998c98', 'eec0d867-7b2e-46d9-a8af-dc70051d3a9a'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:32:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:53 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:32:53 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:32:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:53 devstack sudo[110284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:32:53 devstack sudo[110284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:53 devstack sudo[110284]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.284s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:53 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:32:53 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] Deleted volume successfully.
Aug 12 16:32:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a78d7b0f-db44-4d9c-ad94-dfc6b14a5e17 tempest-VolumesListAdminTestJSON-1083287031 None] Lock "cinder-7afbc077-171c-40ef-adc3-2e6a66059343-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] Acquiring lock "cinder-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] Lock "cinder-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] Acquiring lock "cinder-quobyte-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] Lock "cinder-quobyte-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6" acquired by "delete_volume" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:53 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc5af17-2e82-479b-afaa-bdf5cf09bd08]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:53 devstack sudo[110287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6
Aug 12 16:32:53 devstack sudo[110287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:54 devstack sudo[110287]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6" returned: 0 in 0.369s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:54 devstack sudo[110293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6
Aug 12 16:32:54 devstack sudo[110293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:54 devstack sudo[110293]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6" returned: 0 in 0.263s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:54 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] Lock "cinder-quobyte-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6" released by "delete_volume" :: held 0.676s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:54 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] Created reservations ['9e4d7115-e436-439e-a715-338eb66d7bb8', '6c5eb5fc-f789-44e3-b783-6d22af4557e1', 'bea9cbd2-327e-4986-8579-ef3ae850c6e2', 'd727efc8-08ff-4ac3-8262-50dbb2b6fd7d'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:32:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:54 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:32:54 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:32:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:54 devstack sudo[110296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:32:54 devstack sudo[110296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:54 devstack sudo[110296]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.284s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:54 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:32:54 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] Deleted volume successfully.
Aug 12 16:32:54 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f2358641-e489-491f-905e-65f2e14c2e37 tempest-VolumesListAdminTestJSON-1083287031 None] Lock "cinder-1a9c6631-2ee8-45fc-95aa-b5b1bed495c6-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:55 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-16efef68-6ac3-46ff-9b62-ba48836a8562 req-705e292e-bc82-438c-b812-9fe9621d4ef8 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Terminate volume connection completed successfully.
Aug 12 16:32:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-16efef68-6ac3-46ff-9b62-ba48836a8562 req-705e292e-bc82-438c-b812-9fe9621d4ef8 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Deleting attachment a25ab51c-a82f-4e49-9e5f-d70d2686b959. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:32:56 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Acquiring lock "cinder-ae1ccc4f-dc8d-46c0-b77b-fa8983895309-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:56 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Lock "cinder-ae1ccc4f-dc8d-46c0-b77b-fa8983895309-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:56 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Acquiring lock "cinder-quobyte-ae1ccc4f-dc8d-46c0-b77b-fa8983895309" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:32:56 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Lock "cinder-quobyte-ae1ccc4f-dc8d-46c0-b77b-fa8983895309" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:32:56 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2fcd32-e06c-4810-92b8-4df904ec16f6]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:32:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ae1ccc4f-dc8d-46c0-b77b-fa8983895309 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:56 devstack sudo[110304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ae1ccc4f-dc8d-46c0-b77b-fa8983895309
Aug 12 16:32:56 devstack sudo[110304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:56 devstack sudo[110304]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ae1ccc4f-dc8d-46c0-b77b-fa8983895309" returned: 0 in 0.392s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ae1ccc4f-dc8d-46c0-b77b-fa8983895309 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:56 devstack sudo[110309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ae1ccc4f-dc8d-46c0-b77b-fa8983895309
Aug 12 16:32:56 devstack sudo[110309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:56 devstack sudo[110309]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ae1ccc4f-dc8d-46c0-b77b-fa8983895309" returned: 0 in 0.273s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:56 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Lock "cinder-quobyte-ae1ccc4f-dc8d-46c0-b77b-fa8983895309" released by "delete_volume" :: held 0.724s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:32:56 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Created reservations ['cb0a92bc-6e8c-4bb5-96a8-8f2335a09c03', '85282bde-4108-4a3c-be1a-5923c8fa1ea6', '378a441b-0933-492c-adce-72626c021e4d', 'e1e05320-42eb-4624-89ea-ca37fe053e6c'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:32:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:32:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:32:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:32:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:32:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:32:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:32:56 devstack sudo[110312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:32:56 devstack sudo[110312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:32:57 devstack sudo[110312]: pam_unix(sudo:session): session closed for user root
Aug 12 16:32:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.276s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:32:57 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:32:57 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Deleted volume successfully.
Aug 12 16:32:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d08a7fca-8721-4f00-bbe4-fd95bbfc67b6 tempest-TestServerVolumeAttachScenarioOldVersion-1521892979 None] Lock "cinder-ae1ccc4f-dc8d-46c0-b77b-fa8983895309-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Flow 'volume_create_manager' (e04b09b1-8eed-4f9c-93b0-05c1a461cf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e2c52e8-0eaf-4467-9d42-406305a514bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e2c52e8-0eaf-4467-9d42-406305a514bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1267945026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c580700-d530-4f2e-811b-5a38557109c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71a4975836c435e9de6a594c3cca1b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:02Z,use_quota=True,user_id='66f65a04068542c8868f0d2af428dc88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f755c0-b82a-4ef1-b9e3-7e978076b02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f755c0-b82a-4ef1-b9e3-7e978076b02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6462a9-9bfe-449e-8216-c7dfd59a44a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6462a9-9bfe-449e-8216-c7dfd59a44a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c580700-d530-4f2e-811b-5a38557109c3', 'volume_name': 'volume-0c580700-d530-4f2e-811b-5a38557109c3', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22234722-f184-419c-8f1c-bd3a4101cbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22234722-f184-419c-8f1c-bd3a4101cbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d568dd4f-6a23-46f7-bae7-eedadd0beb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:02 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Volume 0c580700-d530-4f2e-811b-5a38557109c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c580700-d530-4f2e-811b-5a38557109c3', 'volume_size': 1}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1267945026',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c580700-d530-4f2e-811b-5a38557109c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71a4975836c435e9de6a594c3cca1b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:02Z,use_quota=True,user_id='66f65a04068542c8868f0d2af428dc88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Creating volume 0c580700-d530-4f2e-811b-5a38557109c3 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:33:02 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:02 devstack sudo[110345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3 1073741824
Aug 12 16:33:02 devstack sudo[110345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:02 devstack sudo[110345]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3 1073741824" returned: 0 in 0.477s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:02 devstack sudo[110352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3
Aug 12 16:33:02 devstack sudo[110352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:03 devstack sudo[110352]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3" returned: 0 in 0.256s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:33:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d568dd4f-6a23-46f7-bae7-eedadd0beb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c580700-d530-4f2e-811b-5a38557109c3', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f94b0f0-8ac7-4bd2-a426-96e47794cf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:03 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Volume volume-0c580700-d530-4f2e-811b-5a38557109c3 (0c580700-d530-4f2e-811b-5a38557109c3): created successfully
Aug 12 16:33:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f94b0f0-8ac7-4bd2-a426-96e47794cf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Flow 'volume_create_manager' (e04b09b1-8eed-4f9c-93b0-05c1a461cf19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:03 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-26678173-244f-4746-86cf-8e72eec7a992 tempest-VolumesDeleteCascade-173132266 None] Created volume successfully.
Aug 12 16:33:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e6430707-6196-4f8b-b0bc-72a9acd56b52 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e6430707-6196-4f8b-b0bc-72a9acd56b52 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:04 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e6430707-6196-4f8b-b0bc-72a9acd56b52 tempest-VolumesDeleteCascade-173132266 None] Creating offline snapshot f30747f6-cf3b-4e94-9532-b978cbc105c0 of volume 0c580700-d530-4f2e-811b-5a38557109c3 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:33:04 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86255c0-117c-4346-b6e8-50a715132a13]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6430707-6196-4f8b-b0bc-72a9acd56b52 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:04 devstack sudo[110355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3
Aug 12 16:33:04 devstack sudo[110355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:04 devstack sudo[110355]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6430707-6196-4f8b-b0bc-72a9acd56b52 tempest-VolumesDeleteCascade-173132266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3" returned: 0 in 0.379s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6430707-6196-4f8b-b0bc-72a9acd56b52 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:04 devstack sudo[110360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0 1G
Aug 12 16:33:04 devstack sudo[110360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:05 devstack sudo[110360]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6430707-6196-4f8b-b0bc-72a9acd56b52 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0 1G" returned: 0 in 0.490s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6430707-6196-4f8b-b0bc-72a9acd56b52 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c580700-d530-4f2e-811b-5a38557109c3 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:05 devstack sudo[110367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c580700-d530-4f2e-811b-5a38557109c3 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0
Aug 12 16:33:05 devstack sudo[110367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:05 devstack sudo[110367]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6430707-6196-4f8b-b0bc-72a9acd56b52 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c580700-d530-4f2e-811b-5a38557109c3 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0" returned: 0 in 0.301s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:05 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-e6430707-6196-4f8b-b0bc-72a9acd56b52 tempest-VolumesDeleteCascade-173132266 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0 is being set with open permissions: ugo+rw
Aug 12 16:33:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6430707-6196-4f8b-b0bc-72a9acd56b52 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:05 devstack sudo[110375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0
Aug 12 16:33:05 devstack sudo[110375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:05 devstack sudo[110375]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6430707-6196-4f8b-b0bc-72a9acd56b52 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0" returned: 0 in 0.280s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6430707-6196-4f8b-b0bc-72a9acd56b52 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:06 devstack sudo[110380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.info
Aug 12 16:33:06 devstack sudo[110380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:06 devstack sudo[110380]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6430707-6196-4f8b-b0bc-72a9acd56b52 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.info" returned: 0 in 0.314s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:06 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-e6430707-6196-4f8b-b0bc-72a9acd56b52 tempest-VolumesDeleteCascade-173132266 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.info is being set with open permissions: ugo+rw
Aug 12 16:33:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6430707-6196-4f8b-b0bc-72a9acd56b52 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:06 devstack sudo[110383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.info
Aug 12 16:33:06 devstack sudo[110383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:06 devstack sudo[110383]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6430707-6196-4f8b-b0bc-72a9acd56b52 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.info" returned: 0 in 0.294s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e6430707-6196-4f8b-b0bc-72a9acd56b52 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:06 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e6430707-6196-4f8b-b0bc-72a9acd56b52 tempest-VolumesDeleteCascade-173132266 None] Create snapshot completed successfully
Aug 12 16:33:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5b188ca8-15b8-4a19-95c3-f613a333bc4f tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5b188ca8-15b8-4a19-95c3-f613a333bc4f tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5b188ca8-15b8-4a19-95c3-f613a333bc4f tempest-VolumesDeleteCascade-173132266 None] Creating offline snapshot 6f0d513c-2053-4c21-abb2-7d268cf7b0a9 of volume 0c580700-d530-4f2e-811b-5a38557109c3 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:33:07 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[722bfd0e-3384-4fd8-a44e-81f5c5456780]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5b188ca8-15b8-4a19-95c3-f613a333bc4f tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:08 devstack sudo[110412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0
Aug 12 16:33:08 devstack sudo[110412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:08 devstack sudo[110412]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5b188ca8-15b8-4a19-95c3-f613a333bc4f tempest-VolumesDeleteCascade-173132266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0" returned: 0 in 0.515s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5b188ca8-15b8-4a19-95c3-f613a333bc4f tempest-VolumesDeleteCascade-173132266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c580700-d530-4f2e-811b-5a38557109c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:33:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5b188ca8-15b8-4a19-95c3-f613a333bc4f tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:08 devstack sudo[110420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9 1G
Aug 12 16:33:08 devstack sudo[110420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:08 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-e1171ebe-7517-48c7-9647-e5c9498b9b49 tempest-TestShelveInstance-1732532078 None] Terminate volume connection completed successfully.
Aug 12 16:33:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-e1171ebe-7517-48c7-9647-e5c9498b9b49 tempest-TestShelveInstance-1732532078 None] Deleting attachment 6762e1d3-a964-4a4d-98a3-82e4b6a870c2. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:33:08 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] Acquiring lock "cinder-3902aaa8-1477-41fb-a493-e15a72917659-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:08 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] Lock "cinder-3902aaa8-1477-41fb-a493-e15a72917659-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:08 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] Acquiring lock "cinder-quobyte-3902aaa8-1477-41fb-a493-e15a72917659" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:08 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] Lock "cinder-quobyte-3902aaa8-1477-41fb-a493-e15a72917659" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:08 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a975c83-31fa-41fc-bd16-c1ba3ac24416]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3902aaa8-1477-41fb-a493-e15a72917659 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:09 devstack sudo[110432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3902aaa8-1477-41fb-a493-e15a72917659
Aug 12 16:33:09 devstack sudo[110432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:09 devstack sudo[110420]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5b188ca8-15b8-4a19-95c3-f613a333bc4f tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9 1G" returned: 0 in 0.601s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5b188ca8-15b8-4a19-95c3-f613a333bc4f tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:09 devstack sudo[110434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9
Aug 12 16:33:09 devstack sudo[110434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:09 devstack sudo[110432]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3902aaa8-1477-41fb-a493-e15a72917659" returned: 0 in 0.441s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3902aaa8-1477-41fb-a493-e15a72917659 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:09 devstack sudo[110441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3902aaa8-1477-41fb-a493-e15a72917659
Aug 12 16:33:09 devstack sudo[110441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:09 devstack sudo[110434]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5b188ca8-15b8-4a19-95c3-f613a333bc4f tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9" returned: 0 in 0.360s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:09 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-5b188ca8-15b8-4a19-95c3-f613a333bc4f tempest-VolumesDeleteCascade-173132266 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9 is being set with open permissions: ugo+rw
Aug 12 16:33:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5b188ca8-15b8-4a19-95c3-f613a333bc4f tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:09 devstack sudo[110444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9
Aug 12 16:33:09 devstack sudo[110444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:09 devstack sudo[110441]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3902aaa8-1477-41fb-a493-e15a72917659" returned: 0 in 0.289s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] Lock "cinder-quobyte-3902aaa8-1477-41fb-a493-e15a72917659" released by "delete_volume" :: held 0.792s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:09 devstack cinder-volume[94457]: DEBUG cinder.quota [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] Created reservations ['915365b5-ffc9-47d1-99ba-4106e3ee88d7', '7c550f20-3cc1-4ab1-a8a6-d66a15399ef9', '8387c2bd-6f6d-461e-b6dd-fc4562e580b5', '85c8e958-0d9b-42af-9492-9a6917de67de'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:33:09 devstack sudo[110444]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5b188ca8-15b8-4a19-95c3-f613a333bc4f tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9" returned: 0 in 0.303s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5b188ca8-15b8-4a19-95c3-f613a333bc4f tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:09 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5b188ca8-15b8-4a19-95c3-f613a333bc4f tempest-VolumesDeleteCascade-173132266 None] Create snapshot completed successfully
Aug 12 16:33:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:09 devstack sudo[110448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:33:09 devstack sudo[110448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "cinder-0c580700-d530-4f2e-811b-5a38557109c3-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-0c580700-d530-4f2e-811b-5a38557109c3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Performing cascade delete. {{(pid=94457) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "cinder-6f0d513c-2053-4c21-abb2-7d268cf7b0a9-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-6f0d513c-2053-4c21-abb2-7d268cf7b0a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "cinder-quobyte-0c580700-d530-4f2e-811b-5a38557109c3" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-0c580700-d530-4f2e-811b-5a38557109c3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "cinder-quobyte-6f0d513c-2053-4c21-abb2-7d268cf7b0a9" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:10 devstack sudo[110448]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.429s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG cinder.manager [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-6f0d513c-2053-4c21-abb2-7d268cf7b0a9" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Deleting offline snapshot 6f0d513c-2053-4c21-abb2-7d268cf7b0a9 of volume 0c580700-d530-4f2e-811b-5a38557109c3 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] snapshot_file for this snap is: volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:33:10 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] Deleted volume successfully.
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[789f9da1-a96a-4de5-8d29-a3d47983f3b9]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [req-a9d0169a-0ca9-42d6-bc85-eb615f2aadc5 req-0e6152a5-58c0-400d-a6fd-2bdff53792f9 tempest-TestShelveInstance-1732532078 None] Lock "cinder-3902aaa8-1477-41fb-a493-e15a72917659-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:10 devstack sudo[110453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9
Aug 12 16:33:10 devstack sudo[110453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:10 devstack sudo[110453]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9" returned: 0 in 0.407s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c580700-d530-4f2e-811b-5a38557109c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[9050b123-8d03-4e6f-ac19-c31a629db1ff]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:11 devstack sudo[110460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0
Aug 12 16:33:11 devstack sudo[110460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:11 devstack sudo[110460]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0" returned: 0 in 0.521s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c580700-d530-4f2e-811b-5a38557109c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:33:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:11 devstack sudo[110465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9
Aug 12 16:33:11 devstack sudo[110465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:11 devstack sudo[110465]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9" returned: 0 in 0.393s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:11 devstack sudo[110471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9
Aug 12 16:33:11 devstack sudo[110471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:12 devstack sudo[110471]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.6f0d513c-2053-4c21-abb2-7d268cf7b0a9" returned: 0 in 0.342s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-6f0d513c-2053-4c21-abb2-7d268cf7b0a9" released by "_delete_snapshot" :: held 1.804s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-0c580700-d530-4f2e-811b-5a38557109c3" released by "delete_snapshot" :: held 1.842s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:12 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Created reservations ['c5169195-f4b3-43d2-a4f7-6a0eed390b3c', '0d76e092-094e-49c8-ac01-302031e4a0b4', 'cf327525-c024-48d4-b909-f6d29ac828e7', 'b13d585e-2c82-48d0-a862-6e26a41e9d7f'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:33:12 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Delete snapshot completed successfully.
Aug 12 16:33:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-6f0d513c-2053-4c21-abb2-7d268cf7b0a9-delete_snapshot" released by "delete_snapshot" :: held 2.018s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "cinder-f30747f6-cf3b-4e94-9532-b978cbc105c0-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-f30747f6-cf3b-4e94-9532-b978cbc105c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "cinder-quobyte-0c580700-d530-4f2e-811b-5a38557109c3" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-0c580700-d530-4f2e-811b-5a38557109c3" acquired by "delete_snapshot" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "cinder-quobyte-f30747f6-cf3b-4e94-9532-b978cbc105c0" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-f30747f6-cf3b-4e94-9532-b978cbc105c0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Deleting offline snapshot f30747f6-cf3b-4e94-9532-b978cbc105c0 of volume 0c580700-d530-4f2e-811b-5a38557109c3 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:33:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] snapshot_file for this snap is: volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:33:12 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[f824152e-e75a-44ce-b7e7-e2407918543c]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:12 devstack sudo[110475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0
Aug 12 16:33:12 devstack sudo[110475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:12 devstack sudo[110475]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0" returned: 0 in 0.434s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c580700-d530-4f2e-811b-5a38557109c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:33:12 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[921db7cc-3a3e-4fbf-ad1f-ad5789220dbf]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:13 devstack sudo[110480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3
Aug 12 16:33:13 devstack sudo[110480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:13 devstack sudo[110480]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3" returned: 0 in 0.443s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:13 devstack sudo[110485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0
Aug 12 16:33:13 devstack sudo[110485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:13 devstack sudo[110485]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0" returned: 0 in 0.357s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:13 devstack sudo[110491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0
Aug 12 16:33:13 devstack sudo[110491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:14 devstack sudo[110491]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3.f30747f6-cf3b-4e94-9532-b978cbc105c0" returned: 0 in 0.268s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-f30747f6-cf3b-4e94-9532-b978cbc105c0" released by "_delete_snapshot" :: held 1.656s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-0c580700-d530-4f2e-811b-5a38557109c3" released by "delete_snapshot" :: held 1.690s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:14 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Created reservations ['a82881fa-5c1c-4964-a1a2-4f77cfece851', '24210ab1-f65a-49bd-b8ac-eda86b60779b', '8c995ea7-dcc7-46f9-962b-03f89a453225', '81b14e61-d796-43d4-9beb-45bd6a3ca995'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:33:14 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Delete snapshot completed successfully.
Aug 12 16:33:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-f30747f6-cf3b-4e94-9532-b978cbc105c0-delete_snapshot" released by "delete_snapshot" :: held 1.942s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Snapshots deleted, issuing volume delete {{(pid=94457) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Aug 12 16:33:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "cinder-quobyte-0c580700-d530-4f2e-811b-5a38557109c3" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-0c580700-d530-4f2e-811b-5a38557109c3" acquired by "delete_volume" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:14 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[0847ba3f-09d8-458f-b1df-7fcbe640cde6]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:14 devstack sudo[110494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3
Aug 12 16:33:14 devstack sudo[110494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:14 devstack sudo[110494]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3" returned: 0 in 0.402s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:14 devstack sudo[110499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3
Aug 12 16:33:14 devstack sudo[110499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:15 devstack sudo[110499]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0c580700-d530-4f2e-811b-5a38557109c3" returned: 0 in 0.296s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-0c580700-d530-4f2e-811b-5a38557109c3" released by "delete_volume" :: held 0.781s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:15 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Created reservations ['5e2c2192-2a0b-4d31-88fe-27000b565979', '3945aaed-065a-4c86-a69e-f09ac1f876fa', '86db6d53-3797-458e-95e9-512cceb89167', '6c6fcfab-053b-459e-bb35-27625d4bb11a'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:33:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:15 devstack sudo[110503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:33:15 devstack sudo[110503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:15 devstack sudo[110503]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.296s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:15 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:33:15 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Deleted volume successfully.
Aug 12 16:33:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e1af53d7-e384-4fad-ad3e-de0102593751 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-0c580700-d530-4f2e-811b-5a38557109c3-delete_volume" released by "delete_volume" :: held 5.508s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Flow 'volume_create_manager' (ce381246-bcb9-4f63-8ac7-6c3cf601c1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095b620d-adf8-4cc2-b133-23f923297e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095b620d-adf8-4cc2-b133-23f923297e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1878420121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db90efc8-af3c-4fd7-aaac-9eef7aa432b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71a4975836c435e9de6a594c3cca1b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:16Z,use_quota=True,user_id='66f65a04068542c8868f0d2af428dc88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2672c2f2-65ba-4aa5-b238-5803575784a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2672c2f2-65ba-4aa5-b238-5803575784a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c239131-dcc3-48dc-b7b0-41fa10527b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c239131-dcc3-48dc-b7b0-41fa10527b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db90efc8-af3c-4fd7-aaac-9eef7aa432b2', 'volume_name': 'volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3a20a1-b053-4d50-a912-3a5a174acb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd3a20a1-b053-4d50-a912-3a5a174acb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67b34c7-6de1-4da6-9090-0f1efcd6e891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:16 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Volume db90efc8-af3c-4fd7-aaac-9eef7aa432b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2', 'volume_size': 1}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1878420121',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db90efc8-af3c-4fd7-aaac-9eef7aa432b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71a4975836c435e9de6a594c3cca1b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:16Z,use_quota=True,user_id='66f65a04068542c8868f0d2af428dc88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Creating volume db90efc8-af3c-4fd7-aaac-9eef7aa432b2 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:33:16 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:33:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:16 devstack sudo[110506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2 1073741824
Aug 12 16:33:16 devstack sudo[110506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:17 devstack sudo[110506]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2 1073741824" returned: 0 in 0.504s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:17 devstack sudo[110513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2
Aug 12 16:33:17 devstack sudo[110513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:17 devstack sudo[110513]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2" returned: 0 in 0.290s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:33:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67b34c7-6de1-4da6-9090-0f1efcd6e891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66fef41b-e792-4802-bd77-a09926da8f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:17 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Volume volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2 (db90efc8-af3c-4fd7-aaac-9eef7aa432b2): created successfully
Aug 12 16:33:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66fef41b-e792-4802-bd77-a09926da8f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Flow 'volume_create_manager' (ce381246-bcb9-4f63-8ac7-6c3cf601c1fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:17 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-30accd6e-609b-41d4-b867-67ef4573ad80 tempest-VolumesDeleteCascade-173132266 None] Created volume successfully.
Aug 12 16:33:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ba696091-cd72-4c3e-a4a9-46e18fc05620 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ba696091-cd72-4c3e-a4a9-46e18fc05620 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-ba696091-cd72-4c3e-a4a9-46e18fc05620 tempest-VolumesDeleteCascade-173132266 None] Creating offline snapshot 1398e941-60b2-4b1b-a3dd-6866e18f226e of volume db90efc8-af3c-4fd7-aaac-9eef7aa432b2 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:33:18 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aeb049-f36d-4376-94df-ebc355fabbe9]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba696091-cd72-4c3e-a4a9-46e18fc05620 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:19 devstack sudo[110516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2
Aug 12 16:33:19 devstack sudo[110516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:33:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:19 devstack sudo[110516]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba696091-cd72-4c3e-a4a9-46e18fc05620 tempest-VolumesDeleteCascade-173132266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2" returned: 0 in 0.654s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba696091-cd72-4c3e-a4a9-46e18fc05620 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:19 devstack sudo[110521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:33:19 devstack sudo[110521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:19 devstack sudo[110522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e 1G
Aug 12 16:33:19 devstack sudo[110522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:19 devstack sudo[110521]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.339s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:33:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:33:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 29 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:33:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>, <Thread(Rabbit-heartbeat, started daemon 134532925736384)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:33:20 devstack sudo[110522]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba696091-cd72-4c3e-a4a9-46e18fc05620 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e 1G" returned: 0 in 0.574s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba696091-cd72-4c3e-a4a9-46e18fc05620 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:20 devstack sudo[110531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e
Aug 12 16:33:20 devstack sudo[110531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:20 devstack sudo[110531]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba696091-cd72-4c3e-a4a9-46e18fc05620 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e" returned: 0 in 0.390s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:20 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-ba696091-cd72-4c3e-a4a9-46e18fc05620 tempest-VolumesDeleteCascade-173132266 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e is being set with open permissions: ugo+rw
Aug 12 16:33:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba696091-cd72-4c3e-a4a9-46e18fc05620 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:20 devstack sudo[110538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e
Aug 12 16:33:20 devstack sudo[110538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:20 devstack sudo[110538]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba696091-cd72-4c3e-a4a9-46e18fc05620 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e" returned: 0 in 0.265s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba696091-cd72-4c3e-a4a9-46e18fc05620 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:20 devstack sudo[110541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.info
Aug 12 16:33:20 devstack sudo[110541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:21 devstack sudo[110541]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba696091-cd72-4c3e-a4a9-46e18fc05620 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.info" returned: 0 in 0.301s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:21 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-ba696091-cd72-4c3e-a4a9-46e18fc05620 tempest-VolumesDeleteCascade-173132266 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.info is being set with open permissions: ugo+rw
Aug 12 16:33:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba696091-cd72-4c3e-a4a9-46e18fc05620 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:21 devstack sudo[110544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.info
Aug 12 16:33:21 devstack sudo[110544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:21 devstack sudo[110544]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba696091-cd72-4c3e-a4a9-46e18fc05620 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.info" returned: 0 in 0.343s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ba696091-cd72-4c3e-a4a9-46e18fc05620 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.642s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:21 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ba696091-cd72-4c3e-a4a9-46e18fc05620 tempest-VolumesDeleteCascade-173132266 None] Create snapshot completed successfully
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Flow 'volume_create_manager' (d2669e0a-482b-4ff4-b243-4bf9bdd0890d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a936de17-a7b8-4faa-b8c8-0fad085416d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a936de17-a7b8-4faa-b8c8-0fad085416d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-212539267',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba7eb7f-12de-4082-bfa8-2fb7e0a44079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e71a4975836c435e9de6a594c3cca1b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1398e941-60b2-4b1b-a3dd-6866e18f226e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:23Z,use_quota=True,user_id='66f65a04068542c8868f0d2af428dc88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e09ebc9-0403-40b7-9ce2-95667fc6aeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e09ebc9-0403-40b7-9ce2-95667fc6aeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69eb06b1-0725-49e0-962d-0f873c1de580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69eb06b1-0725-49e0-962d-0f873c1de580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9ba7eb7f-12de-4082-bfa8-2fb7e0a44079', 'volume_name': 'volume-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079', 'volume_size': 1, 'snapshot_id': '1398e941-60b2-4b1b-a3dd-6866e18f226e'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e968eb2-a643-4f76-9eba-2d046bcded76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e968eb2-a643-4f76-9eba-2d046bcded76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8a9962-abec-4fd8-ba7e-315aaaaf16b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:22 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Volume 9ba7eb7f-12de-4082-bfa8-2fb7e0a44079: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079', 'volume_size': 1, 'snapshot_id': '1398e941-60b2-4b1b-a3dd-6866e18f226e'}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "cinder-quobyte-1398e941-60b2-4b1b-a3dd-6866e18f226e-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079" by "_create_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-1398e941-60b2-4b1b-a3dd-6866e18f226e-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Creating volume 9ba7eb7f-12de-4082-bfa8-2fb7e0a44079 from snapshot 1398e941-60b2-4b1b-a3dd-6866e18f226e {{(pid=94457) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "cinder-quobyte-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079" by "_copy_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] snapshot: 1398e941-60b2-4b1b-a3dd-6866e18f226e, volume: 9ba7eb7f-12de-4082-bfa8-2fb7e0a44079,  {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b19b0a-9434-4847-9899-07efe2bf14bc]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:23 devstack sudo[110548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e
Aug 12 16:33:23 devstack sudo[110548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:23 devstack sudo[110548]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e" returned: 0 in 0.417s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:33:23 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[184d8fee-05b9-4722-b5a7-2d3013d2d040]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:23 devstack sudo[110553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2
Aug 12 16:33:23 devstack sudo[110553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:23 devstack sudo[110553]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2" returned: 0 in 0.429s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2 {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 12 16:33:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Creating direct copy from snapshot {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 12 16:33:23 devstack cinder-volume[94457]: DEBUG cinder.utils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Path /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079 not found in is_blk_device check {{(pid=94457) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 12 16:33:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:23 devstack sudo[110558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079
Aug 12 16:33:23 devstack sudo[110558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:24 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:33:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Flow 'volume_create_manager' (72aed726-9efe-40bc-b066-4a89a51fae4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75b6a60-0d3b-4157-896a-cc5ebaf491af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a75b6a60-0d3b-4157-896a-cc5ebaf491af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2000292409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2b6073-569e-4d89-903b-f1e8ccb1708a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e64cb7b8f241a19416aec32312af78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:24Z,use_quota=True,user_id='4bce607138e044f0a061164725f39ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9042ae7-de30-41e3-a2f0-a32a7fd3fc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9042ae7-de30-41e3-a2f0-a32a7fd3fc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f9e725-b3e8-4312-a729-9b4ef880d735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5f9e725-b3e8-4312-a729-9b4ef880d735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e2b6073-569e-4d89-903b-f1e8ccb1708a', 'volume_name': 'volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9eb5e58-a12c-42f1-967a-68b2312c0574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9eb5e58-a12c-42f1-967a-68b2312c0574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8a480b-2df1-47e3-a413-c9912d39d4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:24 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Volume 5e2b6073-569e-4d89-903b-f1e8ccb1708a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a', 'volume_size': 1}
Aug 12 16:33:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:29 devstack sudo[110558]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079" returned: 0 in 5.170s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2, size 1024.00 MB, duration 5.17 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079 {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:33:29 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Converted 1024.00 MB image at 198.03 MB/s
Aug 12 16:33:29 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079 is being set with open permissions: ugo+rw
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:29 devstack sudo[110607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079
Aug 12 16:33:29 devstack sudo[110607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:29 devstack sudo[110607]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079" returned: 0 in 0.251s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079" released by "_copy_volume_from_snapshot" :: held 6.371s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-1398e941-60b2-4b1b-a3dd-6866e18f226e-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079" released by "_create_volume_from_snapshot" :: held 6.450s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.468s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.097s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2000292409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2b6073-569e-4d89-903b-f1e8ccb1708a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e64cb7b8f241a19416aec32312af78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:24Z,use_quota=True,user_id='4bce607138e044f0a061164725f39ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Creating volume 5e2b6073-569e-4d89-903b-f1e8ccb1708a {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:33:29 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:29 devstack sudo[110610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a 1073741824
Aug 12 16:33:29 devstack sudo[110610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd8a9962-abec-4fd8-ba7e-315aaaaf16b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079', 'volume_size': 1, 'snapshot_id': '1398e941-60b2-4b1b-a3dd-6866e18f226e'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a676f7fe-d41e-4d3f-b059-dfc851a6f55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:29 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Volume volume-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079 (9ba7eb7f-12de-4082-bfa8-2fb7e0a44079): created successfully
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a676f7fe-d41e-4d3f-b059-dfc851a6f55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Flow 'volume_create_manager' (d2669e0a-482b-4ff4-b243-4bf9bdd0890d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:29 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-cd324aa5-271a-4f05-8481-00ea26b3f5e5 tempest-VolumesDeleteCascade-173132266 None] Created volume successfully.
Aug 12 16:33:29 devstack sudo[110610]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a 1073741824" returned: 0 in 0.474s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:29 devstack sudo[110616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a
Aug 12 16:33:29 devstack sudo[110616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:30 devstack sudo[110616]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a" returned: 0 in 0.295s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8a480b-2df1-47e3-a413-c9912d39d4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f826d448-5b80-40b8-8077-57c12ca58127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:30 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Volume volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a (5e2b6073-569e-4d89-903b-f1e8ccb1708a): created successfully
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f826d448-5b80-40b8-8077-57c12ca58127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Flow 'volume_create_manager' (72aed726-9efe-40bc-b066-4a89a51fae4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:30 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-979a6e06-f1d1-46a5-94d4-6cacbb295fde tempest-CreateVolumesFromSnapshotTest-495712024 None] Created volume successfully.
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "cinder-db90efc8-af3c-4fd7-aaac-9eef7aa432b2-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-db90efc8-af3c-4fd7-aaac-9eef7aa432b2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Performing cascade delete. {{(pid=94457) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "cinder-1398e941-60b2-4b1b-a3dd-6866e18f226e-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-1398e941-60b2-4b1b-a3dd-6866e18f226e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "cinder-quobyte-db90efc8-af3c-4fd7-aaac-9eef7aa432b2" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-db90efc8-af3c-4fd7-aaac-9eef7aa432b2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "cinder-quobyte-1398e941-60b2-4b1b-a3dd-6866e18f226e" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-1398e941-60b2-4b1b-a3dd-6866e18f226e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Deleting offline snapshot 1398e941-60b2-4b1b-a3dd-6866e18f226e of volume db90efc8-af3c-4fd7-aaac-9eef7aa432b2 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] snapshot_file for this snap is: volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d490dfc0-377d-44cd-a252-1f9fef787477]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:30 devstack sudo[110620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e
Aug 12 16:33:30 devstack sudo[110620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:31 devstack sudo[110620]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e" returned: 0 in 0.356s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:33:31 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc30bd07-a380-49c7-81d6-4b0a34faea69]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:31 devstack sudo[110625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2
Aug 12 16:33:31 devstack sudo[110625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2b1ed5fa-1fba-4f3a-952d-b2f32d582411 tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2b1ed5fa-1fba-4f3a-952d-b2f32d582411 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-2b1ed5fa-1fba-4f3a-952d-b2f32d582411 tempest-CreateVolumesFromSnapshotTest-495712024 None] Creating offline snapshot a4e83f8b-91c4-4119-9253-f999fd23e019 of volume 5e2b6073-569e-4d89-903b-f1e8ccb1708a {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:33:31 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[572e5306-7a05-495c-8827-3c001bc0f755]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2b1ed5fa-1fba-4f3a-952d-b2f32d582411 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:31 devstack sudo[110629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a
Aug 12 16:33:31 devstack sudo[110629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:31 devstack sudo[110625]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2" returned: 0 in 0.666s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:31 devstack sudo[110632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e
Aug 12 16:33:31 devstack sudo[110632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:31 devstack sudo[110629]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2b1ed5fa-1fba-4f3a-952d-b2f32d582411 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a" returned: 0 in 0.404s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2b1ed5fa-1fba-4f3a-952d-b2f32d582411 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:31 devstack sudo[110637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019 1G
Aug 12 16:33:31 devstack sudo[110637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:32 devstack sudo[110632]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e" returned: 0 in 0.373s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:32 devstack sudo[110642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e
Aug 12 16:33:32 devstack sudo[110642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:32 devstack sudo[110642]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:32 devstack sudo[110637]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2.1398e941-60b2-4b1b-a3dd-6866e18f226e" returned: 0 in 0.289s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2b1ed5fa-1fba-4f3a-952d-b2f32d582411 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019 1G" returned: 0 in 0.494s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2b1ed5fa-1fba-4f3a-952d-b2f32d582411 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-1398e941-60b2-4b1b-a3dd-6866e18f226e" released by "_delete_snapshot" :: held 1.824s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-db90efc8-af3c-4fd7-aaac-9eef7aa432b2" released by "delete_snapshot" :: held 1.845s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:32 devstack sudo[110648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019
Aug 12 16:33:32 devstack sudo[110648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:32 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Created reservations ['0b947e2e-f102-4cdc-9de3-9db397559490', '64e451cc-2299-4a40-aaa9-cf21bdd8b872', '31a9502b-9885-4bc1-bc41-053675338ba1', '4314e98d-d163-4b1f-88dd-ef329cf5e4cb'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:33:32 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Delete snapshot completed successfully.
Aug 12 16:33:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-1398e941-60b2-4b1b-a3dd-6866e18f226e-delete_snapshot" released by "delete_snapshot" :: held 2.055s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Snapshots deleted, issuing volume delete {{(pid=94457) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Aug 12 16:33:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "cinder-quobyte-db90efc8-af3c-4fd7-aaac-9eef7aa432b2" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-db90efc8-af3c-4fd7-aaac-9eef7aa432b2" acquired by "delete_volume" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:32 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc0370a-c239-46e4-a9f9-910626361442]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:32 devstack sudo[110648]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2b1ed5fa-1fba-4f3a-952d-b2f32d582411 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019" returned: 0 in 0.352s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:32 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-2b1ed5fa-1fba-4f3a-952d-b2f32d582411 tempest-CreateVolumesFromSnapshotTest-495712024 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019 is being set with open permissions: ugo+rw
Aug 12 16:33:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2b1ed5fa-1fba-4f3a-952d-b2f32d582411 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:32 devstack sudo[110655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019
Aug 12 16:33:32 devstack sudo[110655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:32 devstack sudo[110654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2
Aug 12 16:33:32 devstack sudo[110654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:33 devstack sudo[110655]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2b1ed5fa-1fba-4f3a-952d-b2f32d582411 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019" returned: 0 in 0.261s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2b1ed5fa-1fba-4f3a-952d-b2f32d582411 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:33 devstack sudo[110654]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2" returned: 0 in 0.398s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:33 devstack sudo[110662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.info
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:33 devstack sudo[110662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:33 devstack sudo[110664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2
Aug 12 16:33:33 devstack sudo[110664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:33 devstack sudo[110662]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2b1ed5fa-1fba-4f3a-952d-b2f32d582411 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.info" returned: 0 in 0.281s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:33 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-2b1ed5fa-1fba-4f3a-952d-b2f32d582411 tempest-CreateVolumesFromSnapshotTest-495712024 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.info is being set with open permissions: ugo+rw
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2b1ed5fa-1fba-4f3a-952d-b2f32d582411 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:33 devstack sudo[110664]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-db90efc8-af3c-4fd7-aaac-9eef7aa432b2" returned: 0 in 0.272s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:33 devstack sudo[110674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.info
Aug 12 16:33:33 devstack sudo[110674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-db90efc8-af3c-4fd7-aaac-9eef7aa432b2" released by "delete_volume" :: held 0.751s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Created reservations ['6356da59-0796-4e52-aa56-32308d846b76', 'f46c3c24-4817-4b63-b73f-e562d80d0a7a', '8ee3c217-08ff-41db-bede-2243a1861500', 'e5a60ceb-cd9d-4094-8050-9219562ab223'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:33 devstack sudo[110676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:33:33 devstack sudo[110676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:33 devstack sudo[110674]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2b1ed5fa-1fba-4f3a-952d-b2f32d582411 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.info" returned: 0 in 0.265s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2b1ed5fa-1fba-4f3a-952d-b2f32d582411 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.158s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:33 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-2b1ed5fa-1fba-4f3a-952d-b2f32d582411 tempest-CreateVolumesFromSnapshotTest-495712024 None] Create snapshot completed successfully
Aug 12 16:33:33 devstack sudo[110676]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.268s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:33:33 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Deleted volume successfully.
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-552317b2-5c31-4609-bc47-60c2429f2102 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-db90efc8-af3c-4fd7-aaac-9eef7aa432b2-delete_volume" released by "delete_volume" :: held 3.317s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "cinder-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "cinder-quobyte-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079" acquired by "delete_volume" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:34 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bfcc13b-e63e-4f07-96cf-df446ef29f76]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:34 devstack sudo[110680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079
Aug 12 16:33:34 devstack sudo[110680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:34 devstack sudo[110680]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079" returned: 0 in 0.453s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:34 devstack sudo[110685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079
Aug 12 16:33:34 devstack sudo[110685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:34 devstack sudo[110685]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079" returned: 0 in 0.285s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-quobyte-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079" released by "delete_volume" :: held 0.796s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:34 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] Created reservations ['f3b7e142-d67c-47fd-a770-3c75cf8a62fc', 'd6fddbbc-a15e-423d-aabc-e81a76885fc7', 'd2808778-65ab-4c08-bbc6-4ed31c42a152', '315509ca-2e10-480b-93fa-13cf382ad8e3'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:35 devstack sudo[110688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:33:35 devstack sudo[110688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Flow 'volume_create_manager' (d5231d97-cf63-4f78-9457-cd29d37b9104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:35 devstack sudo[110688]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0972c208-48ba-47a3-833e-716a29a5cc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.385s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:33:35 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] Deleted volume successfully.
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0972c208-48ba-47a3-833e-716a29a5cc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1435555133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028f5d1f-cecd-403f-941a-de5f4c7d48dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e64cb7b8f241a19416aec32312af78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:35Z,use_quota=True,user_id='4bce607138e044f0a061164725f39ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a402f8fa-f2cf-430a-b360-087ac2a5c4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a402f8fa-f2cf-430a-b360-087ac2a5c4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ab3a71-7af4-4c70-bd3b-6385f73d51cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ab3a71-7af4-4c70-bd3b-6385f73d51cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '028f5d1f-cecd-403f-941a-de5f4c7d48dd', 'volume_name': 'volume-028f5d1f-cecd-403f-941a-de5f4c7d48dd', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bda60ee-9db5-4ff9-b02b-8b2266af5377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bda60ee-9db5-4ff9-b02b-8b2266af5377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3bb99b-7dd7-46b7-a0fb-9bbea62f4e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:35 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Volume 028f5d1f-cecd-403f-941a-de5f4c7d48dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-028f5d1f-cecd-403f-941a-de5f4c7d48dd', 'volume_size': 1}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1435555133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028f5d1f-cecd-403f-941a-de5f4c7d48dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e64cb7b8f241a19416aec32312af78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:35Z,use_quota=True,user_id='4bce607138e044f0a061164725f39ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Creating volume 028f5d1f-cecd-403f-941a-de5f4c7d48dd {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:33:35 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-028f5d1f-cecd-403f-941a-de5f4c7d48dd 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2c10e524-c75d-4955-8f2e-16e85fbea561 tempest-VolumesDeleteCascade-173132266 None] Lock "cinder-9ba7eb7f-12de-4082-bfa8-2fb7e0a44079-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:35 devstack sudo[110691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-028f5d1f-cecd-403f-941a-de5f4c7d48dd 1073741824
Aug 12 16:33:35 devstack sudo[110691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Flow 'volume_create_manager' (e23603b7-f18b-459d-a950-cafd32c05689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2debdb33-2a1d-4ca9-a3e4-6858739b92b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2debdb33-2a1d-4ca9-a3e4-6858739b92b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-318338534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f4183d-aca8-488a-835b-799703931f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e64cb7b8f241a19416aec32312af78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:36Z,use_quota=True,user_id='4bce607138e044f0a061164725f39ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ced9100-bdea-4ecb-804b-21feec1c223e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ced9100-bdea-4ecb-804b-21feec1c223e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c94ac9-1138-4f04-bd3b-d148b8ab163f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c94ac9-1138-4f04-bd3b-d148b8ab163f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77f4183d-aca8-488a-835b-799703931f6d', 'volume_name': 'volume-77f4183d-aca8-488a-835b-799703931f6d', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c01ce9-dd4b-4b29-9271-c29f6d2c0149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c01ce9-dd4b-4b29-9271-c29f6d2c0149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6217b64f-843b-4a99-a23d-fd0c8520f862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:36 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Volume 77f4183d-aca8-488a-835b-799703931f6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77f4183d-aca8-488a-835b-799703931f6d', 'volume_size': 1}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:36 devstack sudo[110691]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-028f5d1f-cecd-403f-941a-de5f4c7d48dd 1073741824" returned: 0 in 0.739s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-028f5d1f-cecd-403f-941a-de5f4c7d48dd {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:36 devstack sudo[110697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-028f5d1f-cecd-403f-941a-de5f4c7d48dd
Aug 12 16:33:36 devstack sudo[110697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Flow 'volume_create_manager' (b695414e-f450-448f-8e82-6d93e038c0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa8a837-8ee5-4070-9e50-7a5b3ed6f6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (baa8a837-8ee5-4070-9e50-7a5b3ed6f6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-280297899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e31041e-a0ca-4dd7-b0d4-95dac66bafc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e64cb7b8f241a19416aec32312af78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:36Z,use_quota=True,user_id='4bce607138e044f0a061164725f39ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc2cea5-2314-4e59-929a-797e833d79c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cc2cea5-2314-4e59-929a-797e833d79c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066ca56f-a346-408a-b8e1-d00957d477d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066ca56f-a346-408a-b8e1-d00957d477d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e31041e-a0ca-4dd7-b0d4-95dac66bafc1', 'volume_name': 'volume-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f58e82-579d-4aa0-83ff-6c7786f9030e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2f58e82-579d-4aa0-83ff-6c7786f9030e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec5eead-15a7-4e60-b45c-492449cd971b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:36 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Volume 3e31041e-a0ca-4dd7-b0d4-95dac66bafc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1', 'volume_size': 1}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:36 devstack sudo[110697]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-028f5d1f-cecd-403f-941a-de5f4c7d48dd" returned: 0 in 0.343s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.652s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-318338534',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f4183d-aca8-488a-835b-799703931f6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e64cb7b8f241a19416aec32312af78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:36Z,use_quota=True,user_id='4bce607138e044f0a061164725f39ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Creating volume 77f4183d-aca8-488a-835b-799703931f6d {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:33:36 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-77f4183d-aca8-488a-835b-799703931f6d 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:36 devstack sudo[110700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-77f4183d-aca8-488a-835b-799703931f6d 1073741824
Aug 12 16:33:36 devstack sudo[110700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df3bb99b-7dd7-46b7-a0fb-9bbea62f4e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-028f5d1f-cecd-403f-941a-de5f4c7d48dd', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e3aa30-7b94-42c9-8431-be742bcf7a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:36 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Volume volume-028f5d1f-cecd-403f-941a-de5f4c7d48dd (028f5d1f-cecd-403f-941a-de5f4c7d48dd): created successfully
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e3aa30-7b94-42c9-8431-be742bcf7a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Flow 'volume_create_manager' (d5231d97-cf63-4f78-9457-cd29d37b9104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:36 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-09c5b404-d4b8-4332-b80d-8c0aaa8b194f tempest-CreateVolumesFromSnapshotTest-495712024 None] Created volume successfully.
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Flow 'volume_create_manager' (f934e362-9eaa-49b0-98b2-dcd446843537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b67c62-2bde-4237-96d7-f77897f93c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b67c62-2bde-4237-96d7-f77897f93c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1383176975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8257ecf3-aaf8-459d-b705-7c32a1d4ab59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e64cb7b8f241a19416aec32312af78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:37Z,use_quota=True,user_id='4bce607138e044f0a061164725f39ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b94a5a-2139-4594-8e03-510f0d0ca8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b94a5a-2139-4594-8e03-510f0d0ca8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c682c569-1cb4-4e6d-ab57-479d3d1f4db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c682c569-1cb4-4e6d-ab57-479d3d1f4db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8257ecf3-aaf8-459d-b705-7c32a1d4ab59', 'volume_name': 'volume-8257ecf3-aaf8-459d-b705-7c32a1d4ab59', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56504436-8d14-438d-812d-b949f491eaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56504436-8d14-438d-812d-b949f491eaee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723f750b-90ad-449e-969c-d93193a6c259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:37 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Volume 8257ecf3-aaf8-459d-b705-7c32a1d4ab59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8257ecf3-aaf8-459d-b705-7c32a1d4ab59', 'volume_size': 1}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:37 devstack sudo[110700]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-77f4183d-aca8-488a-835b-799703931f6d 1073741824" returned: 0 in 0.655s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-77f4183d-aca8-488a-835b-799703931f6d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:37 devstack sudo[110705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-77f4183d-aca8-488a-835b-799703931f6d
Aug 12 16:33:37 devstack sudo[110705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:37 devstack sudo[110705]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-77f4183d-aca8-488a-835b-799703931f6d" returned: 0 in 0.320s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.073s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-280297899',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e31041e-a0ca-4dd7-b0d4-95dac66bafc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e64cb7b8f241a19416aec32312af78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:36Z,use_quota=True,user_id='4bce607138e044f0a061164725f39ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Creating volume 3e31041e-a0ca-4dd7-b0d4-95dac66bafc1 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:33:37 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6217b64f-843b-4a99-a23d-fd0c8520f862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77f4183d-aca8-488a-835b-799703931f6d', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:37 devstack sudo[110708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1 1073741824
Aug 12 16:33:37 devstack sudo[110708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69333ba1-d105-4c31-8ebf-45dcdd7a2f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:37 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Volume volume-77f4183d-aca8-488a-835b-799703931f6d (77f4183d-aca8-488a-835b-799703931f6d): created successfully
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69333ba1-d105-4c31-8ebf-45dcdd7a2f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Flow 'volume_create_manager' (e23603b7-f18b-459d-a950-cafd32c05689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:37 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ed525682-db7d-4bd5-a07f-cf34944f688e tempest-CreateVolumesFromSnapshotTest-495712024 None] Created volume successfully.
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Flow 'volume_create_manager' (83acfecf-c8ca-4c8e-878c-6f746f455b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9719b081-615b-4307-93d6-b1be4e4c7e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9719b081-615b-4307-93d6-b1be4e4c7e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-354085106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ad38b8-39b5-4a4b-8227-c081d3dfbdc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e64cb7b8f241a19416aec32312af78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:38Z,use_quota=True,user_id='4bce607138e044f0a061164725f39ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05fe13c-3bf0-446d-b51c-6d7a3e3bbb0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a05fe13c-3bf0-446d-b51c-6d7a3e3bbb0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325d1da7-ab50-42d8-bfe3-fe870d127eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325d1da7-ab50-42d8-bfe3-fe870d127eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95ad38b8-39b5-4a4b-8227-c081d3dfbdc8', 'volume_name': 'volume-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04cab88-57f8-4769-9d87-2f1147d9bfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04cab88-57f8-4769-9d87-2f1147d9bfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8b25dc-4ebe-434b-ac16-4c9914e53df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:37 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Volume 95ad38b8-39b5-4a4b-8227-c081d3dfbdc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8', 'volume_size': 1}
Aug 12 16:33:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:38 devstack sudo[110708]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1 1073741824" returned: 0 in 0.636s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:38 devstack sudo[110715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1
Aug 12 16:33:38 devstack sudo[110715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:38 devstack sudo[110715]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1" returned: 0 in 0.308s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:33:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.512s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1383176975',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8257ecf3-aaf8-459d-b705-7c32a1d4ab59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e64cb7b8f241a19416aec32312af78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:37Z,use_quota=True,user_id='4bce607138e044f0a061164725f39ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:33:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Creating volume 8257ecf3-aaf8-459d-b705-7c32a1d4ab59 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:33:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:33:38 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:33:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8257ecf3-aaf8-459d-b705-7c32a1d4ab59 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:38 devstack sudo[110718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8257ecf3-aaf8-459d-b705-7c32a1d4ab59 1073741824
Aug 12 16:33:38 devstack sudo[110718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:38 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aec5eead-15a7-4e60-b45c-492449cd971b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:38 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736d8ada-bdea-4c90-b30c-8cf48900752d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:38 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Volume volume-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1 (3e31041e-a0ca-4dd7-b0d4-95dac66bafc1): created successfully
Aug 12 16:33:38 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (736d8ada-bdea-4c90-b30c-8cf48900752d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:38 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Flow 'volume_create_manager' (b695414e-f450-448f-8e82-6d93e038c0fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:38 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-43bfb20b-1559-435b-8046-56a74f6d462b tempest-CreateVolumesFromSnapshotTest-495712024 None] Created volume successfully.
Aug 12 16:33:39 devstack sudo[110718]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8257ecf3-aaf8-459d-b705-7c32a1d4ab59 1073741824" returned: 0 in 0.619s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8257ecf3-aaf8-459d-b705-7c32a1d4ab59 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:39 devstack sudo[110723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8257ecf3-aaf8-459d-b705-7c32a1d4ab59
Aug 12 16:33:39 devstack sudo[110723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:39 devstack sudo[110723]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8257ecf3-aaf8-459d-b705-7c32a1d4ab59" returned: 0 in 0.294s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:33:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.750s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-354085106',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95ad38b8-39b5-4a4b-8227-c081d3dfbdc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e64cb7b8f241a19416aec32312af78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:38Z,use_quota=True,user_id='4bce607138e044f0a061164725f39ac3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:33:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Creating volume 95ad38b8-39b5-4a4b-8227-c081d3dfbdc8 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:33:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:33:39 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:33:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:39 devstack sudo[110726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8 1073741824
Aug 12 16:33:39 devstack sudo[110726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723f750b-90ad-449e-969c-d93193a6c259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8257ecf3-aaf8-459d-b705-7c32a1d4ab59', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542747cd-0cc7-411a-bbf7-edb17fcf798e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:39 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Volume volume-8257ecf3-aaf8-459d-b705-7c32a1d4ab59 (8257ecf3-aaf8-459d-b705-7c32a1d4ab59): created successfully
Aug 12 16:33:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542747cd-0cc7-411a-bbf7-edb17fcf798e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Flow 'volume_create_manager' (f934e362-9eaa-49b0-98b2-dcd446843537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:39 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-25a5e0aa-d4ec-4fbc-91b6-421dfa6dc447 tempest-CreateVolumesFromSnapshotTest-495712024 None] Created volume successfully.
Aug 12 16:33:40 devstack sudo[110726]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8 1073741824" returned: 0 in 0.716s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:40 devstack sudo[110735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8
Aug 12 16:33:40 devstack sudo[110735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Flow 'volume_create_manager' (2c0961c3-3c9f-4341-8531-7d6ee6c3b3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41c1a7a-bed3-49af-9d5c-a13e4213ca21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41c1a7a-bed3-49af-9d5c-a13e4213ca21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1369481407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43fc03c6-9421-474f-9d2a-14ec38903a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6dce4a803d249598f8e189536210b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:41Z,use_quota=True,user_id='fb67e9bf406c480883515d07f6a3c4e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f74ef0f-d8e8-4a83-b428-94bcbc1c6670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f74ef0f-d8e8-4a83-b428-94bcbc1c6670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:40 devstack sudo[110735]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2f71df-4b3e-47bc-88ac-426a1f8b7c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f2f71df-4b3e-47bc-88ac-426a1f8b7c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43fc03c6-9421-474f-9d2a-14ec38903a04', 'volume_name': 'volume-43fc03c6-9421-474f-9d2a-14ec38903a04', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6142e3ff-072a-4ee8-b3d7-1841d73e40cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6142e3ff-072a-4ee8-b3d7-1841d73e40cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ba885c-b1da-4e15-b659-e47cc18a541a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:40 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Volume 43fc03c6-9421-474f-9d2a-14ec38903a04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43fc03c6-9421-474f-9d2a-14ec38903a04', 'volume_size': 1}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8" returned: 0 in 0.352s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1369481407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43fc03c6-9421-474f-9d2a-14ec38903a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6dce4a803d249598f8e189536210b76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:41Z,use_quota=True,user_id='fb67e9bf406c480883515d07f6a3c4e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Creating volume 43fc03c6-9421-474f-9d2a-14ec38903a04 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:33:40 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43fc03c6-9421-474f-9d2a-14ec38903a04 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a8b25dc-4ebe-434b-ac16-4c9914e53df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:40 devstack sudo[110738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43fc03c6-9421-474f-9d2a-14ec38903a04 1073741824
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0535c98f-4681-4e26-954f-dacf66a9e92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:40 devstack sudo[110738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:40 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Volume volume-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8 (95ad38b8-39b5-4a4b-8227-c081d3dfbdc8): created successfully
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0535c98f-4681-4e26-954f-dacf66a9e92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Flow 'volume_create_manager' (83acfecf-c8ca-4c8e-878c-6f746f455b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:40 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-aa53dfea-80d1-423a-af51-52d1ccf61acf tempest-CreateVolumesFromSnapshotTest-495712024 None] Created volume successfully.
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Flow 'volume_create_manager' (bfb17bcb-52f2-4780-8ad5-4913b659c6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f96c84-b5ba-48ec-ada4-6b7d20474407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f96c84-b5ba-48ec-ada4-6b7d20474407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-261205096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52da305-39e1-479f-b09e-06e63b99d9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492292032f464940afaf74197b4e30d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:41Z,use_quota=True,user_id='718cf8d0d38045908fb637e2fd595fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4efec1df-1f7f-4259-923b-c9d81ea5cc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4efec1df-1f7f-4259-923b-c9d81ea5cc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:41 devstack sudo[110738]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46040fc7-ea25-46df-8642-af2b55d44edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46040fc7-ea25-46df-8642-af2b55d44edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e52da305-39e1-479f-b09e-06e63b99d9f9', 'volume_name': 'volume-e52da305-39e1-479f-b09e-06e63b99d9f9', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d4a57c-1eba-4089-871b-a54560f67705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26d4a57c-1eba-4089-871b-a54560f67705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2710bb-c423-4c68-b688-138587422259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:41 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Volume e52da305-39e1-479f-b09e-06e63b99d9f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e52da305-39e1-479f-b09e-06e63b99d9f9', 'volume_size': 1}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43fc03c6-9421-474f-9d2a-14ec38903a04 1073741824" returned: 0 in 0.551s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43fc03c6-9421-474f-9d2a-14ec38903a04 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "cinder-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:41 devstack sudo[110744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43fc03c6-9421-474f-9d2a-14ec38903a04
Aug 12 16:33:41 devstack sudo[110744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "cinder-quobyte-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-quobyte-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8" acquired by "delete_volume" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d80350-b34c-4a7b-b725-6ce6bcd6db86]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:41 devstack sudo[110744]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43fc03c6-9421-474f-9d2a-14ec38903a04" returned: 0 in 0.310s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:41 devstack sudo[110746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8
Aug 12 16:33:41 devstack sudo[110746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.353s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-261205096',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52da305-39e1-479f-b09e-06e63b99d9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492292032f464940afaf74197b4e30d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:41Z,use_quota=True,user_id='718cf8d0d38045908fb637e2fd595fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Creating volume e52da305-39e1-479f-b09e-06e63b99d9f9 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:33:41 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e52da305-39e1-479f-b09e-06e63b99d9f9 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ba885c-b1da-4e15-b659-e47cc18a541a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43fc03c6-9421-474f-9d2a-14ec38903a04', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:41 devstack sudo[110749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e52da305-39e1-479f-b09e-06e63b99d9f9 1073741824
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc070c41-18a7-4c81-b1ec-79309c28615c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:41 devstack sudo[110749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Flow 'volume_create_manager' (9caee85b-a53c-4a4c-b3fc-c7178cb4674b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8f1280-d6b5-4e46-8c74-2265c803e022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:41 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Volume volume-43fc03c6-9421-474f-9d2a-14ec38903a04 (43fc03c6-9421-474f-9d2a-14ec38903a04): created successfully
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc070c41-18a7-4c81-b1ec-79309c28615c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Flow 'volume_create_manager' (2c0961c3-3c9f-4341-8531-7d6ee6c3b3d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b8f1280-d6b5-4e46-8c74-2265c803e022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-776455191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c0db8e-d926-4d78-8184-85ee01572e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492292032f464940afaf74197b4e30d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:42Z,use_quota=True,user_id='718cf8d0d38045908fb637e2fd595fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf435e3-6c8d-47c4-bd89-e6f876bf4e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecf435e3-6c8d-47c4-bd89-e6f876bf4e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2f371a-048e-483e-aeaf-4e8db5297e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c2f371a-048e-483e-aeaf-4e8db5297e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09c0db8e-d926-4d78-8184-85ee01572e7c', 'volume_name': 'volume-09c0db8e-d926-4d78-8184-85ee01572e7c', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f8304e-ee44-4889-a91c-e464bafaa3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f8304e-ee44-4889-a91c-e464bafaa3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295bb73d-6991-4f8e-893c-c465dc5cdfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:41 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Volume 09c0db8e-d926-4d78-8184-85ee01572e7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09c0db8e-d926-4d78-8184-85ee01572e7c', 'volume_size': 1}
Aug 12 16:33:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:41 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-df405787-04e7-424e-90ab-642c781c325b tempest-VolumesMetadataTest-1912274666 None] Created volume successfully.
Aug 12 16:33:42 devstack sudo[110746]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8" returned: 0 in 0.416s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:42 devstack sudo[110755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8
Aug 12 16:33:42 devstack sudo[110755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:42 devstack sudo[110749]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e52da305-39e1-479f-b09e-06e63b99d9f9 1073741824" returned: 0 in 0.534s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:42 devstack sudo[110755]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e52da305-39e1-479f-b09e-06e63b99d9f9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8" returned: 0 in 0.322s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-quobyte-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8" released by "delete_volume" :: held 0.807s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:42 devstack sudo[110762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e52da305-39e1-479f-b09e-06e63b99d9f9
Aug 12 16:33:42 devstack sudo[110762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] Created reservations ['3abf1fc8-33fa-44b5-b706-0d557ad5e8a3', '7723c70b-163c-4cbe-b87b-14f388be4d98', '9eb42fa7-d96e-49fe-81b8-ddb2f627ae9b', 'f17376c5-ef07-40c2-9de7-e8fbfedbc15e'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:42 devstack sudo[110764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:33:42 devstack sudo[110764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:42 devstack sudo[110762]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "cinder-8257ecf3-aaf8-459d-b705-7c32a1d4ab59-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e52da305-39e1-479f-b09e-06e63b99d9f9" returned: 0 in 0.359s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.796s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-776455191',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c0db8e-d926-4d78-8184-85ee01572e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492292032f464940afaf74197b4e30d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:42Z,use_quota=True,user_id='718cf8d0d38045908fb637e2fd595fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Creating volume 09c0db8e-d926-4d78-8184-85ee01572e7c {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:33:42 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-09c0db8e-d926-4d78-8184-85ee01572e7c 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd2710bb-c423-4c68-b688-138587422259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e52da305-39e1-479f-b09e-06e63b99d9f9', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409883cc-2fb9-4701-9643-35729018fcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:42 devstack sudo[110767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-09c0db8e-d926-4d78-8184-85ee01572e7c 1073741824
Aug 12 16:33:42 devstack sudo[110767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-8257ecf3-aaf8-459d-b705-7c32a1d4ab59-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:42 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Volume volume-e52da305-39e1-479f-b09e-06e63b99d9f9 (e52da305-39e1-479f-b09e-06e63b99d9f9): created successfully
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409883cc-2fb9-4701-9643-35729018fcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Flow 'volume_create_manager' (bfb17bcb-52f2-4780-8ad5-4913b659c6fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:42 devstack sudo[110764]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.392s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:33:42 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-28c66d13-b91a-45ec-b1d9-e7af12f6c2e5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Created volume successfully.
Aug 12 16:33:42 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] Deleted volume successfully.
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "cinder-quobyte-8257ecf3-aaf8-459d-b705-7c32a1d4ab59" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-99b9446a-c047-42bb-9ff8-4024e7b1c04d tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-95ad38b8-39b5-4a4b-8227-c081d3dfbdc8-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-quobyte-8257ecf3-aaf8-459d-b705-7c32a1d4ab59" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:43 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dad166a-fac7-4926-b0f9-fc310c9be68c]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8257ecf3-aaf8-459d-b705-7c32a1d4ab59 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:43 devstack sudo[110770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8257ecf3-aaf8-459d-b705-7c32a1d4ab59
Aug 12 16:33:43 devstack sudo[110770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:43 devstack sudo[110767]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-09c0db8e-d926-4d78-8184-85ee01572e7c 1073741824" returned: 0 in 0.667s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:43 devstack sudo[110770]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8257ecf3-aaf8-459d-b705-7c32a1d4ab59" returned: 0 in 0.487s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8257ecf3-aaf8-459d-b705-7c32a1d4ab59 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-09c0db8e-d926-4d78-8184-85ee01572e7c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:43 devstack sudo[110781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8257ecf3-aaf8-459d-b705-7c32a1d4ab59
Aug 12 16:33:43 devstack sudo[110781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:43 devstack sudo[110783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-09c0db8e-d926-4d78-8184-85ee01572e7c
Aug 12 16:33:43 devstack sudo[110783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:43 devstack sudo[110781]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8257ecf3-aaf8-459d-b705-7c32a1d4ab59" returned: 0 in 0.290s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-quobyte-8257ecf3-aaf8-459d-b705-7c32a1d4ab59" released by "delete_volume" :: held 0.828s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] Acquiring lock "cinder-43fc03c6-9421-474f-9d2a-14ec38903a04-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] Lock "cinder-43fc03c6-9421-474f-9d2a-14ec38903a04-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:43 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] Created reservations ['e044ebc8-8fbd-427c-8660-d967dbb619a6', '23516d9b-b6e3-4c6c-90fb-4f7fa2328a9b', '503c8fef-9125-4170-9b93-995e4019ae55', 'c56bb707-16e9-4d56-bd1a-4fb8910c874c'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:33:43 devstack sudo[110783]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-09c0db8e-d926-4d78-8184-85ee01572e7c" returned: 0 in 0.383s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:43 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:33:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295bb73d-6991-4f8e-893c-c465dc5cdfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09c0db8e-d926-4d78-8184-85ee01572e7c', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098ec7f0-9f5d-488c-8dcf-9df2db247741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] Acquiring lock "cinder-quobyte-43fc03c6-9421-474f-9d2a-14ec38903a04" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:43 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Volume volume-09c0db8e-d926-4d78-8184-85ee01572e7c (09c0db8e-d926-4d78-8184-85ee01572e7c): created successfully
Aug 12 16:33:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (098ec7f0-9f5d-488c-8dcf-9df2db247741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Flow 'volume_create_manager' (9caee85b-a53c-4a4c-b3fc-c7178cb4674b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] Lock "cinder-quobyte-43fc03c6-9421-474f-9d2a-14ec38903a04" acquired by "delete_volume" :: waited 0.032s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:44 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c1a5da54-5b4f-4b9d-942a-306735acbf21 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Created volume successfully.
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f07597f-7a26-4e5a-b2c8-3963794900ad]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43fc03c6-9421-474f-9d2a-14ec38903a04 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:44 devstack sudo[110788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:33:44 devstack sudo[110788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:44 devstack sudo[110787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43fc03c6-9421-474f-9d2a-14ec38903a04
Aug 12 16:33:44 devstack sudo[110787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:44 devstack sudo[110788]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.303s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:33:44 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] Deleted volume successfully.
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e97ac921-2f63-4013-9993-b9ed64e959fc tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-8257ecf3-aaf8-459d-b705-7c32a1d4ab59-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:44 devstack sudo[110787]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43fc03c6-9421-474f-9d2a-14ec38903a04" returned: 0 in 0.433s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43fc03c6-9421-474f-9d2a-14ec38903a04 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:44 devstack sudo[110796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43fc03c6-9421-474f-9d2a-14ec38903a04
Aug 12 16:33:44 devstack sudo[110796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:44 devstack sudo[110796]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43fc03c6-9421-474f-9d2a-14ec38903a04" returned: 0 in 0.249s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] Lock "cinder-quobyte-43fc03c6-9421-474f-9d2a-14ec38903a04" released by "delete_volume" :: held 0.734s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] Created reservations ['71d933c3-919c-432d-86c6-bdbebfe0d593', '5ec75920-1361-4e32-add7-3f69ee3b0c48', 'ac106f6a-fe95-4392-81e2-21f91f4f5360', 'd7950c65-00c0-453f-b309-86555e380644'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:44 devstack sudo[110802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:33:44 devstack sudo[110802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "cinder-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "cinder-quobyte-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-quobyte-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1" acquired by "delete_volume" :: waited 0.029s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:45 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af0871e-1c35-4f3d-97c0-c1f1461a4f08]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:45 devstack sudo[110802]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.383s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:45 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:33:45 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] Deleted volume successfully.
Aug 12 16:33:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-12506063-f0b2-4067-b001-271c99fc0af1 tempest-VolumesMetadataTest-1912274666 None] Lock "cinder-43fc03c6-9421-474f-9d2a-14ec38903a04-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:45 devstack sudo[110805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1
Aug 12 16:33:45 devstack sudo[110805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:45 devstack sudo[110805]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1" returned: 0 in 0.450s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:45 devstack sudo[110810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1
Aug 12 16:33:45 devstack sudo[110810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:46 devstack sudo[110810]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1" returned: 0 in 0.327s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-quobyte-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1" released by "delete_volume" :: held 0.849s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:46 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] Created reservations ['0e241337-90dd-46ed-8fed-388e624fc668', 'b9374eaf-d21b-45bf-a593-61c1a2ad1079', '8097f538-2f92-42e6-b545-0a0f7ff8934c', 'ea7a863f-3dd5-48ae-9c2b-f2cad7ecd566'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:33:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:46 devstack sudo[110813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:33:46 devstack sudo[110813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "cinder-77f4183d-aca8-488a-835b-799703931f6d-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-77f4183d-aca8-488a-835b-799703931f6d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "cinder-quobyte-77f4183d-aca8-488a-835b-799703931f6d" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-quobyte-77f4183d-aca8-488a-835b-799703931f6d" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:46 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa15439f-4799-46e9-b156-7cf946776c7a]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-77f4183d-aca8-488a-835b-799703931f6d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:46 devstack sudo[110816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-77f4183d-aca8-488a-835b-799703931f6d
Aug 12 16:33:46 devstack sudo[110816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.588s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:46 devstack sudo[110813]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:46 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:33:46 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] Deleted volume successfully.
Aug 12 16:33:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a07de7f0-91d3-4956-970f-93369d0b6761 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-3e31041e-a0ca-4dd7-b0d4-95dac66bafc1-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:47 devstack sudo[110816]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-77f4183d-aca8-488a-835b-799703931f6d" returned: 0 in 0.483s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-77f4183d-aca8-488a-835b-799703931f6d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:47 devstack sudo[110830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-77f4183d-aca8-488a-835b-799703931f6d
Aug 12 16:33:47 devstack sudo[110830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:47 devstack sudo[110830]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-77f4183d-aca8-488a-835b-799703931f6d" returned: 0 in 0.538s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:47 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-quobyte-77f4183d-aca8-488a-835b-799703931f6d" released by "delete_volume" :: held 1.116s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:47 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] Created reservations ['5e357a29-138d-45d3-aa4d-d7749747aede', '7552df87-323b-4ca2-acd4-434d01da33d1', '09e5fe0b-6407-4367-95b2-181eb8472685', 'ab8fc03e-30e2-4bd6-835d-a286ec7ba50b'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:33:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:47 devstack sudo[110840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:33:47 devstack sudo[110840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:48 devstack sudo[110840]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.273s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:48 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:33:48 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] Deleted volume successfully.
Aug 12 16:33:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cb66224d-008d-4a21-89e0-f31c6480f7a0 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-77f4183d-aca8-488a-835b-799703931f6d-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "cinder-028f5d1f-cecd-403f-941a-de5f4c7d48dd-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-028f5d1f-cecd-403f-941a-de5f4c7d48dd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "cinder-quobyte-028f5d1f-cecd-403f-941a-de5f4c7d48dd" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-quobyte-028f5d1f-cecd-403f-941a-de5f4c7d48dd" acquired by "delete_volume" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:48 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa516ce-5d26-4e63-93ae-236e5487e8d0]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-028f5d1f-cecd-403f-941a-de5f4c7d48dd {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:49 devstack sudo[110844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-028f5d1f-cecd-403f-941a-de5f4c7d48dd
Aug 12 16:33:49 devstack sudo[110844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:49 devstack sudo[110844]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-028f5d1f-cecd-403f-941a-de5f4c7d48dd" returned: 0 in 0.463s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-028f5d1f-cecd-403f-941a-de5f4c7d48dd {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:49 devstack sudo[110849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-028f5d1f-cecd-403f-941a-de5f4c7d48dd
Aug 12 16:33:49 devstack sudo[110849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:49 devstack sudo[110849]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-028f5d1f-cecd-403f-941a-de5f4c7d48dd" returned: 0 in 0.415s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:49 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-quobyte-028f5d1f-cecd-403f-941a-de5f4c7d48dd" released by "delete_volume" :: held 0.957s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:49 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] Created reservations ['1448fd00-97ca-4ec1-acff-281fd590bce2', 'caa58220-1b72-410a-bc92-19f08e761ce1', 'e65d83e8-2d95-4801-893b-5648384a54f6', '4d52c212-c567-454a-8188-2312f084669b'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:33:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:50 devstack sudo[110889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:33:50 devstack sudo[110889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:50 devstack sudo[110889]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.622s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:50 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:33:50 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] Deleted volume successfully.
Aug 12 16:33:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-00301504-3bdf-49d6-9f5e-d8693dac0d10 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-028f5d1f-cecd-403f-941a-de5f4c7d48dd-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "cinder-a4e83f8b-91c4-4119-9253-f999fd23e019-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-a4e83f8b-91c4-4119-9253-f999fd23e019-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "cinder-quobyte-5e2b6073-569e-4d89-903b-f1e8ccb1708a" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-quobyte-5e2b6073-569e-4d89-903b-f1e8ccb1708a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "cinder-quobyte-a4e83f8b-91c4-4119-9253-f999fd23e019" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-quobyte-a4e83f8b-91c4-4119-9253-f999fd23e019" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] Deleting offline snapshot a4e83f8b-91c4-4119-9253-f999fd23e019 of volume 5e2b6073-569e-4d89-903b-f1e8ccb1708a {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] snapshot_file for this snap is: volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c837dc-4808-4026-9bbc-4027bfc08896]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:51 devstack sudo[110939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019
Aug 12 16:33:51 devstack sudo[110939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Flow 'volume_create_manager' (9bc1e33a-7973-4041-a308-186335e82066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fd98ed-010e-403c-8f0b-3e0bed958e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48fd98ed-010e-403c-8f0b-3e0bed958e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-124328364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2dd4642-5c42-4dfc-a0e7-143b013d47db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3851d0118a884e1b8cff8d7a544641d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:51Z,use_quota=True,user_id='dc7c56155d444b3f9004e2b729bbb1bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e816f7-0f2c-41fe-8b8b-1762bc541e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93e816f7-0f2c-41fe-8b8b-1762bc541e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d4b541-a624-4104-9171-20a7d24c353c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d4b541-a624-4104-9171-20a7d24c353c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2dd4642-5c42-4dfc-a0e7-143b013d47db', 'volume_name': 'volume-e2dd4642-5c42-4dfc-a0e7-143b013d47db', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e38507-d4c7-4b51-a460-ec827e765dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e38507-d4c7-4b51-a460-ec827e765dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398f70f1-3c24-4f50-b140-d105337a6ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:51 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Volume e2dd4642-5c42-4dfc-a0e7-143b013d47db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2dd4642-5c42-4dfc-a0e7-143b013d47db', 'volume_size': 1}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-124328364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2dd4642-5c42-4dfc-a0e7-143b013d47db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3851d0118a884e1b8cff8d7a544641d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:51Z,use_quota=True,user_id='dc7c56155d444b3f9004e2b729bbb1bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Creating volume e2dd4642-5c42-4dfc-a0e7-143b013d47db {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:33:51 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2dd4642-5c42-4dfc-a0e7-143b013d47db 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:51 devstack sudo[110942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2dd4642-5c42-4dfc-a0e7-143b013d47db 1073741824
Aug 12 16:33:51 devstack sudo[110942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:51 devstack sudo[110939]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019" returned: 0 in 0.483s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a502e3-24a1-4652-968c-aee03e366aec]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:51 devstack sudo[110947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a
Aug 12 16:33:51 devstack sudo[110947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:52 devstack sudo[110942]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2dd4642-5c42-4dfc-a0e7-143b013d47db 1073741824" returned: 0 in 0.499s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2dd4642-5c42-4dfc-a0e7-143b013d47db {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:52 devstack sudo[110958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2dd4642-5c42-4dfc-a0e7-143b013d47db
Aug 12 16:33:52 devstack sudo[110958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:52 devstack sudo[110947]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a" returned: 0 in 0.468s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:52 devstack sudo[110960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019
Aug 12 16:33:52 devstack sudo[110960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:52 devstack sudo[110958]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2dd4642-5c42-4dfc-a0e7-143b013d47db" returned: 0 in 0.448s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:52 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:33:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:52 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398f70f1-3c24-4f50-b140-d105337a6ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2dd4642-5c42-4dfc-a0e7-143b013d47db', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:52 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3519c945-001e-48bd-8db3-7c18dff585e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:52 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=128,cinder:UPDATE=167,cinder:INSERT=37,cinder:DELETE=16 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:33:52 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Volume volume-e2dd4642-5c42-4dfc-a0e7-143b013d47db (e2dd4642-5c42-4dfc-a0e7-143b013d47db): created successfully
Aug 12 16:33:52 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3519c945-001e-48bd-8db3-7c18dff585e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:52 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Flow 'volume_create_manager' (9bc1e33a-7973-4041-a308-186335e82066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:52 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=131,cinder:UPDATE=165,cinder:INSERT=43,cinder:DELETE=13 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:33:52 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a766cccc-0976-44ac-8b54-84682b58307f tempest-VolumesTransfersTest-1949496857 None] Created volume successfully.
Aug 12 16:33:52 devstack sudo[110960]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019" returned: 0 in 0.534s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:52 devstack sudo[110967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019
Aug 12 16:33:52 devstack sudo[110967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:52 devstack sudo[110967]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a.a4e83f8b-91c4-4119-9253-f999fd23e019" returned: 0 in 0.258s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-quobyte-a4e83f8b-91c4-4119-9253-f999fd23e019" released by "_delete_snapshot" :: held 1.885s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-quobyte-5e2b6073-569e-4d89-903b-f1e8ccb1708a" released by "delete_snapshot" :: held 1.919s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:53 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] Created reservations ['038c042d-7f13-4522-b56a-b7878861687c', 'b99089ac-013f-4b12-9bf3-d6f48623c323', 'ad2ebe2d-017f-43b5-9c2c-0fc36faa429f', '39cde238-fab1-4a2e-9887-65e63a12667c'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:33:53 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] Delete snapshot completed successfully.
Aug 12 16:33:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5de3abfa-6773-4440-9ccb-b3df5bb8517e tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-a4e83f8b-91c4-4119-9253-f999fd23e019-delete_snapshot" released by "delete_snapshot" :: held 2.082s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "cinder-5e2b6073-569e-4d89-903b-f1e8ccb1708a-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-5e2b6073-569e-4d89-903b-f1e8ccb1708a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "cinder-quobyte-5e2b6073-569e-4d89-903b-f1e8ccb1708a" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-quobyte-5e2b6073-569e-4d89-903b-f1e8ccb1708a" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:53 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[96965e71-dc22-44a4-b514-17e4040c261d]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:53 devstack sudo[110970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a
Aug 12 16:33:53 devstack sudo[110970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:53 devstack sudo[110970]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a" returned: 0 in 0.481s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:53 devstack sudo[110975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a
Aug 12 16:33:53 devstack sudo[110975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:54 devstack sudo[110975]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e2b6073-569e-4d89-903b-f1e8ccb1708a" returned: 0 in 0.371s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:54 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-quobyte-5e2b6073-569e-4d89-903b-f1e8ccb1708a" released by "delete_volume" :: held 0.954s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:54 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] Created reservations ['be03843c-fa94-430e-9cfd-1a285352ea9f', 'f44d8590-51c2-4b6e-bc72-6f0149b27dc8', 'ed0d7522-153b-4192-aa64-e2a0d67361f5', '741cb942-df1f-4f36-a3d0-db239a4757a7'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:33:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:54 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:54 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:54 devstack sudo[110979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:33:54 devstack sudo[110979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:54 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-0805c09c-a68b-4957-ba00-c564dccda4ae tempest-VolumesTransfersTest-1113229992 None] Transfer volume completed successfully.
Aug 12 16:33:54 devstack sudo[110979]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.332s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:54 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:33:54 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] Deleted volume successfully.
Aug 12 16:33:54 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-d5e058b9-91c1-443e-98ed-19d2982154c6 tempest-CreateVolumesFromSnapshotTest-495712024 None] Lock "cinder-5e2b6073-569e-4d89-903b-f1e8ccb1708a-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] Acquiring lock "cinder-e2dd4642-5c42-4dfc-a0e7-143b013d47db-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] Lock "cinder-e2dd4642-5c42-4dfc-a0e7-143b013d47db-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] Acquiring lock "cinder-quobyte-e2dd4642-5c42-4dfc-a0e7-143b013d47db" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] Lock "cinder-quobyte-e2dd4642-5c42-4dfc-a0e7-143b013d47db" acquired by "delete_volume" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:55 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[460d416c-dd75-4c6f-bc31-669d6c4ed882]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2dd4642-5c42-4dfc-a0e7-143b013d47db {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:55 devstack sudo[110983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2dd4642-5c42-4dfc-a0e7-143b013d47db
Aug 12 16:33:55 devstack sudo[110983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:55 devstack sudo[110983]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2dd4642-5c42-4dfc-a0e7-143b013d47db" returned: 0 in 0.431s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2dd4642-5c42-4dfc-a0e7-143b013d47db {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:55 devstack sudo[110989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2dd4642-5c42-4dfc-a0e7-143b013d47db
Aug 12 16:33:55 devstack sudo[110989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:56 devstack sudo[110989]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2dd4642-5c42-4dfc-a0e7-143b013d47db" returned: 0 in 0.267s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:56 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] Lock "cinder-quobyte-e2dd4642-5c42-4dfc-a0e7-143b013d47db" released by "delete_volume" :: held 0.756s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:56 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] Created reservations ['17e78ebc-e86d-4097-a4f8-cace84805aef', 'd3642270-0094-44c8-87ce-34a83fd442cf', 'e37870c6-8c51-4627-8b55-240ae193724b', 'c27108cb-3272-4ddf-b517-ea238ec11e57'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:33:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:56 devstack sudo[110992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:33:56 devstack sudo[110992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:56 devstack sudo[110992]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.302s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:56 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:33:56 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] Deleted volume successfully.
Aug 12 16:33:56 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4ed4ae2c-0d85-42d3-8210-1f028966b9e1 tempest-VolumesTransfersTest-1499506153 None] Lock "cinder-e2dd4642-5c42-4dfc-a0e7-143b013d47db-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Flow 'volume_create_manager' (7219feb7-4989-4377-bf41-3e2331bf6d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3888c8-6140-487f-9824-7012ac2fa9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d3888c8-6140-487f-9824-7012ac2fa9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1143389296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1fdb2a5-f931-46ee-875b-f2c0b4688f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3851d0118a884e1b8cff8d7a544641d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:57Z,use_quota=True,user_id='dc7c56155d444b3f9004e2b729bbb1bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339e2051-6a58-465f-9ab3-8c2850e84cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (339e2051-6a58-465f-9ab3-8c2850e84cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27e0820-c49a-449c-a58c-90859187c30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27e0820-c49a-449c-a58c-90859187c30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1fdb2a5-f931-46ee-875b-f2c0b4688f19', 'volume_name': 'volume-a1fdb2a5-f931-46ee-875b-f2c0b4688f19', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71d2532-2f0b-4e1a-95da-79322006f02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f71d2532-2f0b-4e1a-95da-79322006f02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1111e6b-9388-433b-9954-8d7fe593ed09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:57 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Volume a1fdb2a5-f931-46ee-875b-f2c0b4688f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1fdb2a5-f931-46ee-875b-f2c0b4688f19', 'volume_size': 1}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1143389296',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1fdb2a5-f931-46ee-875b-f2c0b4688f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3851d0118a884e1b8cff8d7a544641d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:57Z,use_quota=True,user_id='dc7c56155d444b3f9004e2b729bbb1bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Creating volume a1fdb2a5-f931-46ee-875b-f2c0b4688f19 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:33:57 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a1fdb2a5-f931-46ee-875b-f2c0b4688f19 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:57 devstack sudo[110995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a1fdb2a5-f931-46ee-875b-f2c0b4688f19 1073741824
Aug 12 16:33:57 devstack sudo[110995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:57 devstack sudo[110995]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a1fdb2a5-f931-46ee-875b-f2c0b4688f19 1073741824" returned: 0 in 0.582s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a1fdb2a5-f931-46ee-875b-f2c0b4688f19 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:57 devstack sudo[111006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a1fdb2a5-f931-46ee-875b-f2c0b4688f19
Aug 12 16:33:57 devstack sudo[111006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:58 devstack sudo[111006]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a1fdb2a5-f931-46ee-875b-f2c0b4688f19" returned: 0 in 0.355s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:33:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1111e6b-9388-433b-9954-8d7fe593ed09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1fdb2a5-f931-46ee-875b-f2c0b4688f19', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddd5b54-969e-4fbb-8cbc-a9fd30ac7ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:58 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Volume volume-a1fdb2a5-f931-46ee-875b-f2c0b4688f19 (a1fdb2a5-f931-46ee-875b-f2c0b4688f19): created successfully
Aug 12 16:33:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddd5b54-969e-4fbb-8cbc-a9fd30ac7ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Flow 'volume_create_manager' (7219feb7-4989-4377-bf41-3e2331bf6d62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:58 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-857a1482-86ed-4a5b-895c-45d194d433c1 tempest-VolumesTransfersTest-1949496857 None] Created volume successfully.
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Flow 'volume_create_manager' (443fee0a-94d5-48d9-ae27-ff8aa4b1e8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9fa8aa-70b8-45a5-af36-3bb44720e176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9fa8aa-70b8-45a5-af36-3bb44720e176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-655092319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad527aa-b19c-41b5-9588-68aa4773cd3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd8d9a8b06694051893fdedd2e713849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:59Z,use_quota=True,user_id='eb8ed126ef134fcf9afd7fad386cc8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa51c7d5-7e4e-4f16-ac2b-34e284f7be0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa51c7d5-7e4e-4f16-ac2b-34e284f7be0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7993b6b0-b88a-49ea-a971-855a551ddbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7993b6b0-b88a-49ea-a971-855a551ddbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ad527aa-b19c-41b5-9588-68aa4773cd3a', 'volume_name': 'volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4438f6f2-0f00-4ba9-ac4e-92ab391e94d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4438f6f2-0f00-4ba9-ac4e-92ab391e94d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78eac986-4fed-4f90-ac94-cc81454175b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:33:59 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Volume 2ad527aa-b19c-41b5-9588-68aa4773cd3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a', 'volume_size': 1}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-655092319',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad527aa-b19c-41b5-9588-68aa4773cd3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd8d9a8b06694051893fdedd2e713849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:33:59Z,use_quota=True,user_id='eb8ed126ef134fcf9afd7fad386cc8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Creating volume 2ad527aa-b19c-41b5-9588-68aa4773cd3a {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:33:59 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:59 devstack sudo[111015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a 1073741824
Aug 12 16:33:59 devstack sudo[111015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] Acquiring lock "cinder-a1fdb2a5-f931-46ee-875b-f2c0b4688f19-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] Lock "cinder-a1fdb2a5-f931-46ee-875b-f2c0b4688f19-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] Acquiring lock "cinder-quobyte-a1fdb2a5-f931-46ee-875b-f2c0b4688f19" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] Lock "cinder-quobyte-a1fdb2a5-f931-46ee-875b-f2c0b4688f19" acquired by "delete_volume" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca906ecd-f987-44a1-b25c-976af2d6c68e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a1fdb2a5-f931-46ee-875b-f2c0b4688f19 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:59 devstack sudo[111015]: pam_unix(sudo:session): session closed for user root
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a 1073741824" returned: 0 in 0.538s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:33:59 devstack sudo[111020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a1fdb2a5-f931-46ee-875b-f2c0b4688f19
Aug 12 16:33:59 devstack sudo[111020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:33:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:33:59 devstack sudo[111023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a
Aug 12 16:33:59 devstack sudo[111023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:00 devstack sudo[111020]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a1fdb2a5-f931-46ee-875b-f2c0b4688f19" returned: 0 in 0.397s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a1fdb2a5-f931-46ee-875b-f2c0b4688f19 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:00 devstack sudo[111023]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a" returned: 0 in 0.272s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:00 devstack sudo[111029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a1fdb2a5-f931-46ee-875b-f2c0b4688f19
Aug 12 16:34:00 devstack sudo[111029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78eac986-4fed-4f90-ac94-cc81454175b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b14117-2636-41e3-8c0d-15051da60df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:00 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Volume volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a (2ad527aa-b19c-41b5-9588-68aa4773cd3a): created successfully
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55b14117-2636-41e3-8c0d-15051da60df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Flow 'volume_create_manager' (443fee0a-94d5-48d9-ae27-ff8aa4b1e8f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:34:00 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e797dd5e-3a49-4973-ae42-06fcfa6acd09 tempest-VolumeDependencyTests-1370801018 None] Created volume successfully.
Aug 12 16:34:00 devstack sudo[111029]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a1fdb2a5-f931-46ee-875b-f2c0b4688f19" returned: 0 in 0.274s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] Lock "cinder-quobyte-a1fdb2a5-f931-46ee-875b-f2c0b4688f19" released by "delete_volume" :: held 0.712s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] Created reservations ['976f15e4-6822-4ee4-b9cf-4baa87cd303a', '5d9078e9-a9c2-40e9-a8af-ccf7471ba990', '15696150-6f1e-4939-8fbe-3ec271dea9a9', '49f3d90a-9d00-4f33-afea-0f3f4df46c61'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:00 devstack sudo[111033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:34:00 devstack sudo[111033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:00 devstack sudo[111033]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.272s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:34:00 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] Deleted volume successfully.
Aug 12 16:34:00 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bfffa7c6-37d0-49f7-860a-6d3327ea508b tempest-VolumesTransfersTest-1499506153 None] Lock "cinder-a1fdb2a5-f931-46ee-875b-f2c0b4688f19-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2726c6ed-9299-4739-ad7b-1563518bda04 tempest-VolumeDependencyTests-1370801018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2726c6ed-9299-4739-ad7b-1563518bda04 tempest-VolumeDependencyTests-1370801018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-2726c6ed-9299-4739-ad7b-1563518bda04 tempest-VolumeDependencyTests-1370801018 None] Creating offline snapshot d2589ebe-2248-4b1b-88fb-828c5b1efa1b of volume 2ad527aa-b19c-41b5-9588-68aa4773cd3a {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:34:01 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8c76da-662b-4801-8002-e562d08652b3]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2726c6ed-9299-4739-ad7b-1563518bda04 tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:01 devstack sudo[111036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a
Aug 12 16:34:01 devstack sudo[111036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:01 devstack sudo[111036]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2726c6ed-9299-4739-ad7b-1563518bda04 tempest-VolumeDependencyTests-1370801018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a" returned: 0 in 0.410s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2726c6ed-9299-4739-ad7b-1563518bda04 tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:01 devstack sudo[111041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b 1G
Aug 12 16:34:01 devstack sudo[111041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:02 devstack sudo[111041]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2726c6ed-9299-4739-ad7b-1563518bda04 tempest-VolumeDependencyTests-1370801018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b 1G" returned: 0 in 0.515s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2726c6ed-9299-4739-ad7b-1563518bda04 tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:02 devstack sudo[111047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b
Aug 12 16:34:02 devstack sudo[111047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:02 devstack sudo[111047]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2726c6ed-9299-4739-ad7b-1563518bda04 tempest-VolumeDependencyTests-1370801018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b" returned: 0 in 0.332s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:02 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-2726c6ed-9299-4739-ad7b-1563518bda04 tempest-VolumeDependencyTests-1370801018 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b is being set with open permissions: ugo+rw
Aug 12 16:34:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2726c6ed-9299-4739-ad7b-1563518bda04 tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:02 devstack sudo[111052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b
Aug 12 16:34:02 devstack sudo[111052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:03 devstack sudo[111052]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2726c6ed-9299-4739-ad7b-1563518bda04 tempest-VolumeDependencyTests-1370801018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b" returned: 0 in 0.292s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2726c6ed-9299-4739-ad7b-1563518bda04 tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:03 devstack sudo[111055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.info
Aug 12 16:34:03 devstack sudo[111055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:03 devstack sudo[111055]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2726c6ed-9299-4739-ad7b-1563518bda04 tempest-VolumeDependencyTests-1370801018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.info" returned: 0 in 0.310s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:03 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-2726c6ed-9299-4739-ad7b-1563518bda04 tempest-VolumeDependencyTests-1370801018 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.info is being set with open permissions: ugo+rw
Aug 12 16:34:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2726c6ed-9299-4739-ad7b-1563518bda04 tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:03 devstack sudo[111058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.info
Aug 12 16:34:03 devstack sudo[111058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:03 devstack sudo[111058]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2726c6ed-9299-4739-ad7b-1563518bda04 tempest-VolumeDependencyTests-1370801018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.info" returned: 0 in 0.262s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2726c6ed-9299-4739-ad7b-1563518bda04 tempest-VolumeDependencyTests-1370801018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.229s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:03 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-2726c6ed-9299-4739-ad7b-1563518bda04 tempest-VolumeDependencyTests-1370801018 None] Create snapshot completed successfully
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Flow 'volume_create_manager' (dad0df8c-4dd5-4d1c-aca7-a6e100be3d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f288ac2-1fc0-489e-8d54-c1ea22317e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f288ac2-1fc0-489e-8d54-c1ea22317e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:34:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-597796777',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd8d9a8b06694051893fdedd2e713849',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d2589ebe-2248-4b1b-88fb-828c5b1efa1b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:34:05Z,use_quota=True,user_id='eb8ed126ef134fcf9afd7fad386cc8e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584c0f40-3264-41da-8174-3740c7f9a250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584c0f40-3264-41da-8174-3740c7f9a250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be533916-cc27-4bba-9e5d-687d30b2c189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be533916-cc27-4bba-9e5d-687d30b2c189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3', 'volume_name': 'volume-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3', 'volume_size': 1, 'snapshot_id': 'd2589ebe-2248-4b1b-88fb-828c5b1efa1b'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbeaabe6-4acf-4c17-824d-6fd57621bce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbeaabe6-4acf-4c17-824d-6fd57621bce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc713659-759a-477b-bb2a-5a437275a6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:05 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Volume ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3', 'volume_size': 1, 'snapshot_id': 'd2589ebe-2248-4b1b-88fb-828c5b1efa1b'}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Acquiring lock "cinder-quobyte-d2589ebe-2248-4b1b-88fb-828c5b1efa1b-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3" by "_create_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Lock "cinder-quobyte-d2589ebe-2248-4b1b-88fb-828c5b1efa1b-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Creating volume ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3 from snapshot d2589ebe-2248-4b1b-88fb-828c5b1efa1b {{(pid=94457) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Acquiring lock "cinder-quobyte-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3" by "_copy_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Lock "cinder-quobyte-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] snapshot: d2589ebe-2248-4b1b-88fb-828c5b1efa1b, volume: ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3,  {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1b28e8-0dd2-4ecb-ba15-c466dae753ed]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:05 devstack sudo[111084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b
Aug 12 16:34:05 devstack sudo[111084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:05 devstack sudo[111084]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b" returned: 0 in 0.366s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74ba23f-3c73-4c77-8874-1990ad507caf]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:06 devstack sudo[111089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a
Aug 12 16:34:06 devstack sudo[111089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:06 devstack sudo[111089]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a" returned: 0 in 0.397s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 12 16:34:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Creating direct copy from snapshot {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 12 16:34:06 devstack cinder-volume[94457]: DEBUG cinder.utils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Path /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3 not found in is_blk_device check {{(pid=94457) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 12 16:34:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:06 devstack sudo[111094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3
Aug 12 16:34:06 devstack sudo[111094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:06 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:34:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Flow 'volume_create_manager' (92624cdd-54c8-405e-8d60-e7e0a6c213c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:34:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb120903-edb6-424f-aa05-80eb13828df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb120903-edb6-424f-aa05-80eb13828df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-42638912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53af3e77-d89f-4797-aae0-6671c88a3ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361fc1eed72f4e8c90855c47103226f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:34:07Z,use_quota=True,user_id='0ce5d8ce91c5422188dcb054e34a5a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee81a4c8-f695-4c09-a7d4-4c73c9c330de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee81a4c8-f695-4c09-a7d4-4c73c9c330de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7005257e-093e-4e65-b1a8-81459e0e2c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:07 devstack cinder-volume[94457]: DEBUG cinder.image.glance [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Creating Keystone auth plugin from conf {{(pid=94457) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 12 16:34:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7005257e-093e-4e65-b1a8-81459e0e2c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '53af3e77-d89f-4797-aae0-6671c88a3ce6', 'volume_name': 'volume-53af3e77-d89f-4797-aae0-6671c88a3ce6', 'volume_size': 1, 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b7d6f6e2f82493fb2262e877eaef313', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'created_at': datetime.datetime(2026, 8, 12, 14, 14, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 14, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86433006-753f-43b5-b60e-7f6f6c1c77c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b633f7200>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cdd974d-63b0-47d9-b1c3-37a84a23d86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cdd974d-63b0-47d9-b1c3-37a84a23d86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08909fe5-497c-48f1-85e0-55904bd51f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:08 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Volume 53af3e77-d89f-4797-aae0-6671c88a3ce6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-53af3e77-d89f-4797-aae0-6671c88a3ce6', 'volume_size': 1, 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b7d6f6e2f82493fb2262e877eaef313', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'created_at': datetime.datetime(2026, 8, 12, 14, 14, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 14, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86433006-753f-43b5-b60e-7f6f6c1c77c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b633f7200>}
Aug 12 16:34:08 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Trying to clone 53af3e77-d89f-4797-aae0-6671c88a3ce6 from image 86433006-753f-43b5-b60e-7f6f6c1c77c6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]). {{(pid=94457) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 12 16:34:09 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_cr7gqn6xdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 12 16:34:09 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Image download 20.69 MB at 20.69 MB/s
Aug 12 16:34:09 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[077ec6e8-d0d5-40eb-952e-7244db69a430]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_cr7gqn6xdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:09 devstack sudo[111108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_cr7gqn6xdevstack@QuobyteHD
Aug 12 16:34:09 devstack sudo[111108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:09 devstack sudo[111108]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_cr7gqn6xdevstack@QuobyteHD" returned: 0 in 0.671s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:09 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Temporary image 86433006-753f-43b5-b60e-7f6f6c1c77c6 is fetched for user 0ce5d8ce91c5422188dcb054e34a5a39. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 12 16:34:10 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[82532519-8df7-4bc7-a3c3-fce50d77babd]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_cr7gqn6xdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:10 devstack sudo[111116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_cr7gqn6xdevstack@QuobyteHD
Aug 12 16:34:10 devstack sudo[111116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:10 devstack sudo[111116]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_cr7gqn6xdevstack@QuobyteHD" returned: 0 in 0.600s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:11 devstack sudo[111094]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3" returned: 0 in 4.886s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a, size 1024.00 MB, duration 4.89 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3 {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:34:11 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Converted 1024.00 MB image at 209.50 MB/s
Aug 12 16:34:11 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3 is being set with open permissions: ugo+rw
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:11 devstack sudo[111123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3
Aug 12 16:34:11 devstack sudo[111123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:11 devstack sudo[111123]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3" returned: 0 in 0.249s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Lock "cinder-quobyte-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3" released by "_copy_volume_from_snapshot" :: held 5.978s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Lock "cinder-quobyte-d2589ebe-2248-4b1b-88fb-828c5b1efa1b-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3" released by "_create_volume_from_snapshot" :: held 6.047s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.062s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.908s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-42638912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53af3e77-d89f-4797-aae0-6671c88a3ce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361fc1eed72f4e8c90855c47103226f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:34:07Z,use_quota=True,user_id='0ce5d8ce91c5422188dcb054e34a5a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Creating volume 53af3e77-d89f-4797-aae0-6671c88a3ce6 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:34:11 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:11 devstack sudo[111126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6 1073741824
Aug 12 16:34:11 devstack sudo[111126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc713659-759a-477b-bb2a-5a437275a6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3', 'volume_size': 1, 'snapshot_id': 'd2589ebe-2248-4b1b-88fb-828c5b1efa1b'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f280ada0-3c44-4719-b543-079bc5091148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:11 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Volume volume-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3 (ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3): created successfully
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f280ada0-3c44-4719-b543-079bc5091148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Flow 'volume_create_manager' (dad0df8c-4dd5-4d1c-aca7-a6e100be3d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:34:11 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-0b4de7e6-0df4-4cc2-ab73-72360c64a285 tempest-VolumeDependencyTests-1370801018 None] Created volume successfully.
Aug 12 16:34:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] Acquiring lock "cinder-d2589ebe-2248-4b1b-88fb-828c5b1efa1b-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:12 devstack sudo[111126]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6 1073741824" returned: 0 in 0.461s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] Lock "cinder-d2589ebe-2248-4b1b-88fb-828c5b1efa1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] Acquiring lock "cinder-quobyte-2ad527aa-b19c-41b5-9588-68aa4773cd3a" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] Lock "cinder-quobyte-2ad527aa-b19c-41b5-9588-68aa4773cd3a" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] Acquiring lock "cinder-quobyte-d2589ebe-2248-4b1b-88fb-828c5b1efa1b" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] Lock "cinder-quobyte-d2589ebe-2248-4b1b-88fb-828c5b1efa1b" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] Deleting offline snapshot d2589ebe-2248-4b1b-88fb-828c5b1efa1b of volume 2ad527aa-b19c-41b5-9588-68aa4773cd3a {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] snapshot_file for this snap is: volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:34:12 devstack sudo[111132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6
Aug 12 16:34:12 devstack sudo[111132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[71034d0f-3824-466e-b4f3-07bb8bcea3f4]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:12 devstack sudo[111134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b
Aug 12 16:34:12 devstack sudo[111134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:12 devstack sudo[111132]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6" returned: 0 in 0.294s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Attempting download of 86433006-753f-43b5-b60e-7f6f6c1c77c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}])) to volume 53af3e77-d89f-4797-aae0-6671c88a3ce6. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[046d1451-2069-44bd-8748-d3376ea8abbe]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_8nck4pof {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:12 devstack sudo[111134]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b" returned: 0 in 0.383s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[15632d83-d20f-4de6-bacc-c2ab731e122c]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:12 devstack sudo[111139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_8nck4pof
Aug 12 16:34:12 devstack sudo[111139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:12 devstack sudo[111141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a
Aug 12 16:34:12 devstack sudo[111141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:12 devstack sudo[111139]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_8nck4pof" returned: 0 in 0.343s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_8nck4pof {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:12 devstack sudo[111146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_8nck4pof
Aug 12 16:34:12 devstack sudo[111146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:13 devstack sudo[111141]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a" returned: 0 in 0.563s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:13 devstack sudo[111146]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_8nck4pof" returned: 1 in 0.324s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_86433006-753f-43b5-b60e-7f6f6c1c77c6_8nck4pof' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:34:13 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafe2cfc-a595-42b8-a984-2bb453745076]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_cr7gqn6xdevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:13 devstack sudo[111153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b
Aug 12 16:34:13 devstack sudo[111153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:13 devstack sudo[111154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_cr7gqn6xdevstack@QuobyteHD
Aug 12 16:34:13 devstack sudo[111154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:13 devstack sudo[111153]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b" returned: 0 in 0.329s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:13 devstack sudo[111154]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_cr7gqn6xdevstack@QuobyteHD" returned: 0 in 0.329s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:13 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] 86433006-753f-43b5-b60e-7f6f6c1c77c6 was qcow2, converting to qcow2 {{(pid=94457) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 12 16:34:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_cr7gqn6xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:13 devstack sudo[111163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b
Aug 12 16:34:13 devstack sudo[111163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:13 devstack sudo[111165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_cr7gqn6xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6
Aug 12 16:34:13 devstack sudo[111165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:13 devstack sudo[111163]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a.d2589ebe-2248-4b1b-88fb-828c5b1efa1b" returned: 0 in 0.249s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] Lock "cinder-quobyte-d2589ebe-2248-4b1b-88fb-828c5b1efa1b" released by "_delete_snapshot" :: held 1.644s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] Lock "cinder-quobyte-2ad527aa-b19c-41b5-9588-68aa4773cd3a" released by "delete_snapshot" :: held 1.688s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:13 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] Created reservations ['f0159b5b-0d15-4996-b10e-ec8d8b516dc3', 'a1ebfde4-0f04-4e80-8263-dd1afa07b3ad', '3921b4c6-1522-4a9a-97f1-7c54644f4b2b', 'e968cb44-d1f2-4cf6-ab71-dcef7284cf81'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:34:13 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] Delete snapshot completed successfully.
Aug 12 16:34:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-83fce607-fdf9-401a-8b15-4e2f8308b14c tempest-VolumeDependencyTests-1370801018 None] Lock "cinder-d2589ebe-2248-4b1b-88fb-828c5b1efa1b-delete_snapshot" released by "delete_snapshot" :: held 1.833s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] Acquiring lock "cinder-2ad527aa-b19c-41b5-9588-68aa4773cd3a-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] Lock "cinder-2ad527aa-b19c-41b5-9588-68aa4773cd3a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] Acquiring lock "cinder-quobyte-2ad527aa-b19c-41b5-9588-68aa4773cd3a" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] Lock "cinder-quobyte-2ad527aa-b19c-41b5-9588-68aa4773cd3a" acquired by "delete_volume" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:14 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa794e8-eb54-41e4-87a5-fab14e60a704]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:14 devstack sudo[111173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a
Aug 12 16:34:14 devstack sudo[111173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:14 devstack sudo[111173]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a" returned: 0 in 0.409s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:14 devstack sudo[111180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a
Aug 12 16:34:14 devstack sudo[111180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:15 devstack sudo[111180]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2ad527aa-b19c-41b5-9588-68aa4773cd3a" returned: 0 in 0.312s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] Lock "cinder-quobyte-2ad527aa-b19c-41b5-9588-68aa4773cd3a" released by "delete_volume" :: held 0.799s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] Created reservations ['5e0a9fb9-c8b4-4bd1-99ff-2c926d63af48', 'caf832c3-41ae-471c-9955-44fc27ec8860', '31bc3427-3c50-49fb-a238-fc19eb6cd6fc', '904563b3-6158-459f-a73b-ba819f5c2d28'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:15 devstack sudo[111165]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_cr7gqn6xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6" returned: 0 in 1.797s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_86433006-753f-43b5-b60e-7f6f6c1c77c6_cr7gqn6xdevstack@QuobyteHD, size 112.00 MB, duration 1.80 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6 {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:34:15 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Converted 112.00 MB image at 62.28 MB/s
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:15 devstack sudo[111184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:34:15 devstack sudo[111184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:15 devstack sudo[111186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6 1G
Aug 12 16:34:15 devstack sudo[111186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] Acquiring lock "cinder-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] Lock "cinder-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] Acquiring lock "cinder-quobyte-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] Lock "cinder-quobyte-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3" acquired by "delete_volume" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[8416b69d-737b-4d3b-9178-345cae1ad939]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:15 devstack sudo[111184]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.423s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:34:15 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] Deleted volume successfully.
Aug 12 16:34:15 devstack sudo[111186]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6 1G" returned: 0 in 0.413s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Downloaded image 86433006-753f-43b5-b60e-7f6f6c1c77c6 ((None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}])) to volume 53af3e77-d89f-4797-aae0-6671c88a3ce6 successfully. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Temporary image 86433006-753f-43b5-b60e-7f6f6c1c77c6 for user 0ce5d8ce91c5422188dcb054e34a5a39 is deleted. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Marking volume 53af3e77-d89f-4797-aae0-6671c88a3ce6 as bootable. {{(pid=94457) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6c1823aa-13d4-4dc1-a333-9970f8c7fe75 tempest-VolumeDependencyTests-1370801018 None] Lock "cinder-2ad527aa-b19c-41b5-9588-68aa4773cd3a-delete_volume" released by "delete_volume" :: held 1.517s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Copying metadata from image 86433006-753f-43b5-b60e-7f6f6c1c77c6 to 53af3e77-d89f-4797-aae0-6671c88a3ce6. {{(pid=94457) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Creating volume glance metadata for volume 53af3e77-d89f-4797-aae0-6671c88a3ce6 backed by image 86433006-753f-43b5-b60e-7f6f6c1c77c6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=94457) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 12 16:34:15 devstack sudo[111191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3
Aug 12 16:34:15 devstack sudo[111191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08909fe5-497c-48f1-85e0-55904bd51f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53af3e77-d89f-4797-aae0-6671c88a3ce6', 'volume_size': 1, 'image_id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/86433006-753f-43b5-b60e-7f6f6c1c77c6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '5b7d6f6e2f82493fb2262e877eaef313', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '86433006-753f-43b5-b60e-7f6f6c1c77c6', 'created_at': datetime.datetime(2026, 8, 12, 14, 14, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 14, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/86433006-753f-43b5-b60e-7f6f6c1c77c6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b633f7200>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da717586-9627-4aa2-8270-f649d70e63a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:15 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Volume volume-53af3e77-d89f-4797-aae0-6671c88a3ce6 (53af3e77-d89f-4797-aae0-6671c88a3ce6): created successfully
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da717586-9627-4aa2-8270-f649d70e63a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Flow 'volume_create_manager' (92624cdd-54c8-405e-8d60-e7e0a6c213c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:34:15 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-b27d35e4-aa22-434e-882a-b2072741b72f tempest-VolumesExtendTest-1851365669 None] Created volume successfully.
Aug 12 16:34:15 devstack sudo[111191]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3" returned: 0 in 0.424s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:16 devstack sudo[111201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3
Aug 12 16:34:16 devstack sudo[111201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:16 devstack sudo[111201]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3" returned: 0 in 0.255s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] Lock "cinder-quobyte-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3" released by "delete_volume" :: held 0.750s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] Created reservations ['0aa262d0-5d7d-44b6-99fe-f6b734b26d11', '87fadf41-1264-450c-800a-5cc1e32b7c86', 'fd1141d1-4d19-46e2-a4df-52db36e014ec', '818d02ae-9865-4057-95a2-8652a91dc8fc'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-45fba943-9342-424b-a4b1-685060a57d29 req-cd5f3e96-eb51-4685-aedb-43babeb27cf1 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-45fba943-9342-424b-a4b1-685060a57d29 req-cd5f3e96-eb51-4685-aedb-43babeb27cf1 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-45fba943-9342-424b-a4b1-685060a57d29 req-cd5f3e96-eb51-4685-aedb-43babeb27cf1 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-45fba943-9342-424b-a4b1-685060a57d29 req-cd5f3e96-eb51-4685-aedb-43babeb27cf1 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-e52da305-39e1-479f-b09e-06e63b99d9f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '222b95c9-d4a8-473f-8603-b08ccaceb255', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:34:16 devstack sudo[111212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:34:16 devstack sudo[111212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:16 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-45fba943-9342-424b-a4b1-685060a57d29 req-cd5f3e96-eb51-4685-aedb-43babeb27cf1 tempest-TestServerVolumeAttachmentScenario-1840991775 None] attachment_update completed successfully.
Aug 12 16:34:16 devstack sudo[111212]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.271s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:34:16 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] Deleted volume successfully.
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f1ebe2bf-ad23-474f-8090-47e7879ed934 tempest-VolumeDependencyTests-1370801018 None] Lock "cinder-ced05d1a-c6ee-49ec-a9d6-a3dbc6da97f3-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-82edb068-6a8a-424c-aef5-36692252af9e tempest-VolumesExtendTest-1851365669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-82edb068-6a8a-424c-aef5-36692252af9e tempest-VolumesExtendTest-1851365669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0077bcf-0f60-4063-a461-ebdc128d613b]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-82edb068-6a8a-424c-aef5-36692252af9e tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:17 devstack sudo[111599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6
Aug 12 16:34:17 devstack sudo[111599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:17 devstack sudo[111599]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-82edb068-6a8a-424c-aef5-36692252af9e tempest-VolumesExtendTest-1851365669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6" returned: 0 in 0.475s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-82edb068-6a8a-424c-aef5-36692252af9e tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6 2G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-82edb068-6a8a-424c-aef5-36692252af9e tempest-VolumesExtendTest-1851365669 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6 2G" returned: 0 in 0.122s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-82edb068-6a8a-424c-aef5-36692252af9e tempest-VolumesExtendTest-1851365669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.624s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:17 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-82edb068-6a8a-424c-aef5-36692252af9e tempest-VolumesExtendTest-1851365669 None] Extend volume completed successfully.
Aug 12 16:34:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] Acquiring lock "cinder-53af3e77-d89f-4797-aae0-6671c88a3ce6-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] Lock "cinder-53af3e77-d89f-4797-aae0-6671c88a3ce6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] Acquiring lock "cinder-quobyte-53af3e77-d89f-4797-aae0-6671c88a3ce6" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] Lock "cinder-quobyte-53af3e77-d89f-4797-aae0-6671c88a3ce6" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:18 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[30539f76-9926-47ee-9e4d-fdda3fde51d7]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:18 devstack sudo[111608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6
Aug 12 16:34:18 devstack sudo[111608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6" returned: 0 in 0.404s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:18 devstack sudo[111608]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:18 devstack sudo[111613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6
Aug 12 16:34:18 devstack sudo[111613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:19 devstack sudo[111613]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-53af3e77-d89f-4797-aae0-6671c88a3ce6" returned: 0 in 0.252s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] Lock "cinder-quobyte-53af3e77-d89f-4797-aae0-6671c88a3ce6" released by "delete_volume" :: held 0.702s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] Created reservations ['a09e374c-f2ab-4e34-a59f-19d16df6c456', 'd264a154-c542-44d7-a325-e336eb25cad2', 'cb178673-efa9-47b5-a770-d65c3fdf3e94', '8593d3ce-de48-46bb-89a3-9cdb6e634b3f'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:19 devstack sudo[111616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:34:19 devstack sudo[111616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:19 devstack sudo[111616]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.263s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:34:19 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] Deleted volume successfully.
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a57a9d01-9fcc-4e64-88e4-5f29b5672b60 tempest-VolumesExtendTest-1851365669 None] Lock "cinder-53af3e77-d89f-4797-aae0-6671c88a3ce6-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:19 devstack sudo[111619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:34:19 devstack sudo[111619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:19 devstack sudo[111619]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.263s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 29 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>, <Thread(Rabbit-heartbeat, started daemon 134532925736384)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Flow 'volume_create_manager' (4647bbc7-feb0-473d-bccd-8f14c9848982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:34:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fa17d2-88c7-4748-862d-ed533a482ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90fa17d2-88c7-4748-862d-ed533a482ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1257401411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be67cfbe-f739-4150-be26-7654400197f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361fc1eed72f4e8c90855c47103226f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:34:20Z,use_quota=True,user_id='0ce5d8ce91c5422188dcb054e34a5a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e20896-ef34-4e2d-84af-3b236add38d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e20896-ef34-4e2d-84af-3b236add38d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944bdc8f-623b-484f-867c-ef69a6a194d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944bdc8f-623b-484f-867c-ef69a6a194d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be67cfbe-f739-4150-be26-7654400197f4', 'volume_name': 'volume-be67cfbe-f739-4150-be26-7654400197f4', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669693ef-85b7-4995-bdd1-ab0801b232ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (669693ef-85b7-4995-bdd1-ab0801b232ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76dc2d6a-9920-4e7f-adde-a571bba71355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:20 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Volume be67cfbe-f739-4150-be26-7654400197f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be67cfbe-f739-4150-be26-7654400197f4', 'volume_size': 1}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1257401411',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be67cfbe-f739-4150-be26-7654400197f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361fc1eed72f4e8c90855c47103226f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:34:20Z,use_quota=True,user_id='0ce5d8ce91c5422188dcb054e34a5a39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Creating volume be67cfbe-f739-4150-be26-7654400197f4 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:34:20 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:20 devstack sudo[111622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4 1073741824
Aug 12 16:34:20 devstack sudo[111622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:20 devstack sudo[111622]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4 1073741824" returned: 0 in 0.453s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:20 devstack sudo[111632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4
Aug 12 16:34:20 devstack sudo[111632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:20 devstack sudo[111632]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4" returned: 0 in 0.271s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76dc2d6a-9920-4e7f-adde-a571bba71355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be67cfbe-f739-4150-be26-7654400197f4', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de6a690-c442-4b7b-9e73-44bdb7f3733f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:20 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Volume volume-be67cfbe-f739-4150-be26-7654400197f4 (be67cfbe-f739-4150-be26-7654400197f4): created successfully
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5de6a690-c442-4b7b-9e73-44bdb7f3733f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Flow 'volume_create_manager' (4647bbc7-feb0-473d-bccd-8f14c9848982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:34:20 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-8053e4fa-b39b-4d0a-85ef-b9361f834ba3 tempest-VolumesExtendTest-1851365669 None] Created volume successfully.
Aug 12 16:34:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3262fd5a-b17b-48fc-ad70-06ce11f74abd tempest-VolumesExtendTest-1851365669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3262fd5a-b17b-48fc-ad70-06ce11f74abd tempest-VolumesExtendTest-1851365669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-3262fd5a-b17b-48fc-ad70-06ce11f74abd tempest-VolumesExtendTest-1851365669 None] Creating offline snapshot ac3ca696-2966-40cf-865c-2296b82a9f57 of volume be67cfbe-f739-4150-be26-7654400197f4 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:34:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-014384e7-11c7-4b72-8b2c-169dd6dc260d req-0db4b83a-c147-4495-b656-95874e7325d5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:21 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d321a1c3-0d3e-40d0-b8ec-58327f7d6646]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3262fd5a-b17b-48fc-ad70-06ce11f74abd tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:21 devstack sudo[111643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4
Aug 12 16:34:21 devstack sudo[111643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:21 devstack sudo[111643]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3262fd5a-b17b-48fc-ad70-06ce11f74abd tempest-VolumesExtendTest-1851365669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4" returned: 0 in 0.354s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3262fd5a-b17b-48fc-ad70-06ce11f74abd tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:21 devstack sudo[111648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57 1G
Aug 12 16:34:21 devstack sudo[111648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:21 devstack sudo[111648]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3262fd5a-b17b-48fc-ad70-06ce11f74abd tempest-VolumesExtendTest-1851365669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57 1G" returned: 0 in 0.385s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3262fd5a-b17b-48fc-ad70-06ce11f74abd tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be67cfbe-f739-4150-be26-7654400197f4 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:22 devstack sudo[111654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be67cfbe-f739-4150-be26-7654400197f4 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57
Aug 12 16:34:22 devstack sudo[111654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:22 devstack sudo[111654]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3262fd5a-b17b-48fc-ad70-06ce11f74abd tempest-VolumesExtendTest-1851365669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be67cfbe-f739-4150-be26-7654400197f4 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57" returned: 0 in 0.296s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:22 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-3262fd5a-b17b-48fc-ad70-06ce11f74abd tempest-VolumesExtendTest-1851365669 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57 is being set with open permissions: ugo+rw
Aug 12 16:34:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3262fd5a-b17b-48fc-ad70-06ce11f74abd tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:22 devstack sudo[111659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57
Aug 12 16:34:22 devstack sudo[111659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:22 devstack sudo[111659]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3262fd5a-b17b-48fc-ad70-06ce11f74abd tempest-VolumesExtendTest-1851365669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57" returned: 0 in 0.245s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3262fd5a-b17b-48fc-ad70-06ce11f74abd tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:22 devstack sudo[111662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.info
Aug 12 16:34:22 devstack sudo[111662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:22 devstack sudo[111662]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3262fd5a-b17b-48fc-ad70-06ce11f74abd tempest-VolumesExtendTest-1851365669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.info" returned: 0 in 0.254s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:22 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-3262fd5a-b17b-48fc-ad70-06ce11f74abd tempest-VolumesExtendTest-1851365669 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.info is being set with open permissions: ugo+rw
Aug 12 16:34:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3262fd5a-b17b-48fc-ad70-06ce11f74abd tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:22 devstack sudo[111665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.info
Aug 12 16:34:22 devstack sudo[111665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:23 devstack sudo[111665]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3262fd5a-b17b-48fc-ad70-06ce11f74abd tempest-VolumesExtendTest-1851365669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.info" returned: 0 in 0.255s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3262fd5a-b17b-48fc-ad70-06ce11f74abd tempest-VolumesExtendTest-1851365669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-014384e7-11c7-4b72-8b2c-169dd6dc260d req-0db4b83a-c147-4495-b656-95874e7325d5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.852s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-014384e7-11c7-4b72-8b2c-169dd6dc260d req-0db4b83a-c147-4495-b656-95874e7325d5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:23 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-3262fd5a-b17b-48fc-ad70-06ce11f74abd tempest-VolumesExtendTest-1851365669 None] Create snapshot completed successfully
Aug 12 16:34:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-014384e7-11c7-4b72-8b2c-169dd6dc260d req-0db4b83a-c147-4495-b656-95874e7325d5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-09c0db8e-d926-4d78-8184-85ee01572e7c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a132dae-0d4b-4b45-979f-6a530e365edd', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:34:23 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-014384e7-11c7-4b72-8b2c-169dd6dc260d req-0db4b83a-c147-4495-b656-95874e7325d5 tempest-TestServerVolumeAttachmentScenario-1840991775 None] attachment_update completed successfully.
Aug 12 16:34:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7d904ac4-d5bf-45e1-9317-f8eaac6b58ff tempest-VolumesExtendTest-1851365669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7d904ac4-d5bf-45e1-9317-f8eaac6b58ff tempest-VolumesExtendTest-1851365669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:23 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[0571cc55-bae7-4912-a2f6-45ed374b0107]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d904ac4-d5bf-45e1-9317-f8eaac6b58ff tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:23 devstack sudo[111672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4
Aug 12 16:34:23 devstack sudo[111672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:23 devstack sudo[111672]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d904ac4-d5bf-45e1-9317-f8eaac6b58ff tempest-VolumesExtendTest-1851365669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4" returned: 0 in 0.394s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d904ac4-d5bf-45e1-9317-f8eaac6b58ff tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57 2G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7d904ac4-d5bf-45e1-9317-f8eaac6b58ff tempest-VolumesExtendTest-1851365669 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57 2G" returned: 0 in 0.140s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7d904ac4-d5bf-45e1-9317-f8eaac6b58ff tempest-VolumesExtendTest-1851365669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.569s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:24 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-7d904ac4-d5bf-45e1-9317-f8eaac6b58ff tempest-VolumesExtendTest-1851365669 None] Extend volume completed successfully.
Aug 12 16:34:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] Acquiring lock "cinder-ac3ca696-2966-40cf-865c-2296b82a9f57-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] Lock "cinder-ac3ca696-2966-40cf-865c-2296b82a9f57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] Acquiring lock "cinder-quobyte-be67cfbe-f739-4150-be26-7654400197f4" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] Lock "cinder-quobyte-be67cfbe-f739-4150-be26-7654400197f4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] Acquiring lock "cinder-quobyte-ac3ca696-2966-40cf-865c-2296b82a9f57" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] Lock "cinder-quobyte-ac3ca696-2966-40cf-865c-2296b82a9f57" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] Deleting offline snapshot ac3ca696-2966-40cf-865c-2296b82a9f57 of volume be67cfbe-f739-4150-be26-7654400197f4 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:34:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] snapshot_file for this snap is: volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:34:24 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f49f0f0-723e-4d08-82cc-912746d27268]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:24 devstack sudo[111682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57
Aug 12 16:34:24 devstack sudo[111682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:25 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-983f8d35-7ce2-4caa-b651-19b9a08307d8 req-be70718f-c95c-4686-9d84-3acff247f3a3 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Terminate volume connection completed successfully.
Aug 12 16:34:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-983f8d35-7ce2-4caa-b651-19b9a08307d8 req-be70718f-c95c-4686-9d84-3acff247f3a3 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Deleting attachment 7a132dae-0d4b-4b45-979f-6a530e365edd. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:34:25 devstack sudo[111682]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57" returned: 0 in 0.379s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be67cfbe-f739-4150-be26-7654400197f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:34:25 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[53252f0b-f339-455d-84eb-d850dc1e4fd1]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:25 devstack sudo[111692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4
Aug 12 16:34:25 devstack sudo[111692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:25 devstack sudo[111692]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4" returned: 0 in 0.376s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:25 devstack sudo[111698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57
Aug 12 16:34:25 devstack sudo[111698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:25 devstack sudo[111698]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57" returned: 0 in 0.381s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:25 devstack sudo[111704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57
Aug 12 16:34:25 devstack sudo[111704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:26 devstack sudo[111704]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4.ac3ca696-2966-40cf-865c-2296b82a9f57" returned: 0 in 0.287s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] Lock "cinder-quobyte-ac3ca696-2966-40cf-865c-2296b82a9f57" released by "_delete_snapshot" :: held 1.550s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] Lock "cinder-quobyte-be67cfbe-f739-4150-be26-7654400197f4" released by "delete_snapshot" :: held 1.573s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:26 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] Created reservations ['bd7ea4cd-2615-495d-bc68-d5b66fae0a24', '6a7514db-d3ac-4caf-b07f-334e27d616b0', 'de6078c0-4516-40fc-acd4-2dd45f43d1b4', '0130223b-8208-4f14-b647-0288494b4551'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:34:26 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] Delete snapshot completed successfully.
Aug 12 16:34:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ddb64301-1718-4826-a8bb-d6d43b2c8e86 tempest-VolumesExtendTest-1851365669 None] Lock "cinder-ac3ca696-2966-40cf-865c-2296b82a9f57-delete_snapshot" released by "delete_snapshot" :: held 1.710s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:26 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-c00b52a8-dab0-44a7-8315-43b7374a8f24 req-68d2f256-d82f-42ab-baf4-6899fd048be9 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Terminate volume connection completed successfully.
Aug 12 16:34:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-c00b52a8-dab0-44a7-8315-43b7374a8f24 req-68d2f256-d82f-42ab-baf4-6899fd048be9 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Deleting attachment 222b95c9-d4a8-473f-8603-b08ccaceb255. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:34:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] Acquiring lock "cinder-be67cfbe-f739-4150-be26-7654400197f4-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] Lock "cinder-be67cfbe-f739-4150-be26-7654400197f4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] Acquiring lock "cinder-quobyte-be67cfbe-f739-4150-be26-7654400197f4" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] Lock "cinder-quobyte-be67cfbe-f739-4150-be26-7654400197f4" acquired by "delete_volume" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:26 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ae18da-10e0-454f-b3ea-38080c2d7961]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:27 devstack sudo[111739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4
Aug 12 16:34:27 devstack sudo[111739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:27 devstack sudo[111739]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4" returned: 0 in 0.369s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:27 devstack sudo[111744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4
Aug 12 16:34:27 devstack sudo[111744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:27 devstack sudo[111744]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-be67cfbe-f739-4150-be26-7654400197f4" returned: 0 in 0.301s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:27 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] Lock "cinder-quobyte-be67cfbe-f739-4150-be26-7654400197f4" released by "delete_volume" :: held 0.737s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:27 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] Created reservations ['eaf0aacd-c952-4791-8e07-47c6b7dca3e7', '76e9b2f7-cf03-4e5d-9af3-6f3bd07e8060', '5e895bbd-6859-4041-85b6-6149632c4dc6', 'caf6f25d-7d77-4204-8e5b-d9e03275ce0f'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:34:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:34:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:34:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:27 devstack sudo[111782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:34:27 devstack sudo[111782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:28 devstack sudo[111782]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.535s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:28 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:34:28 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] Deleted volume successfully.
Aug 12 16:34:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f6777c1e-0ae9-4be3-8d5b-6ae8f686fc2e tempest-VolumesExtendTest-1851365669 None] Lock "cinder-be67cfbe-f739-4150-be26-7654400197f4-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Acquiring lock "cinder-09c0db8e-d926-4d78-8184-85ee01572e7c-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "cinder-09c0db8e-d926-4d78-8184-85ee01572e7c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Acquiring lock "cinder-quobyte-09c0db8e-d926-4d78-8184-85ee01572e7c" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "cinder-quobyte-09c0db8e-d926-4d78-8184-85ee01572e7c" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:31 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[51642cef-1cb0-4cfd-88ec-e1f5d9e6de73]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-09c0db8e-d926-4d78-8184-85ee01572e7c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:31 devstack sudo[111814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-09c0db8e-d926-4d78-8184-85ee01572e7c
Aug 12 16:34:31 devstack sudo[111814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:32 devstack sudo[111814]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-09c0db8e-d926-4d78-8184-85ee01572e7c" returned: 0 in 0.372s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-09c0db8e-d926-4d78-8184-85ee01572e7c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:32 devstack sudo[111819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-09c0db8e-d926-4d78-8184-85ee01572e7c
Aug 12 16:34:32 devstack sudo[111819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:32 devstack sudo[111819]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-09c0db8e-d926-4d78-8184-85ee01572e7c" returned: 0 in 0.273s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "cinder-quobyte-09c0db8e-d926-4d78-8184-85ee01572e7c" released by "delete_volume" :: held 0.702s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:32 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Created reservations ['c4fff247-4282-4954-9f8c-81b5827c5b23', '8a882462-b691-4b4f-afaf-3cdc5d914e4c', 'bb753b81-84aa-4bef-baec-9c7878113d92', '07bbb8e8-0bac-4a28-bf6a-5f9671ac092c'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:34:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:34:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:34:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:32 devstack sudo[111822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:34:32 devstack sudo[111822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:32 devstack sudo[111822]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.271s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:32 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:34:32 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Deleted volume successfully.
Aug 12 16:34:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6bd8ac8b-9689-40e5-9ddd-e3e41598d336 tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "cinder-09c0db8e-d926-4d78-8184-85ee01572e7c-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] Acquiring lock "cinder-e52da305-39e1-479f-b09e-06e63b99d9f9-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "cinder-e52da305-39e1-479f-b09e-06e63b99d9f9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] Acquiring lock "cinder-quobyte-e52da305-39e1-479f-b09e-06e63b99d9f9" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "cinder-quobyte-e52da305-39e1-479f-b09e-06e63b99d9f9" acquired by "delete_volume" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:33 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ba6798-9577-45d5-950f-64101a08457b]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e52da305-39e1-479f-b09e-06e63b99d9f9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:33 devstack sudo[111825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e52da305-39e1-479f-b09e-06e63b99d9f9
Aug 12 16:34:33 devstack sudo[111825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:33 devstack sudo[111825]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e52da305-39e1-479f-b09e-06e63b99d9f9" returned: 0 in 0.375s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e52da305-39e1-479f-b09e-06e63b99d9f9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:33 devstack sudo[111833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e52da305-39e1-479f-b09e-06e63b99d9f9
Aug 12 16:34:33 devstack sudo[111833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:33 devstack sudo[111833]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e52da305-39e1-479f-b09e-06e63b99d9f9" returned: 0 in 0.252s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "cinder-quobyte-e52da305-39e1-479f-b09e-06e63b99d9f9" released by "delete_volume" :: held 0.676s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:33 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] Created reservations ['c0827b2b-3b8a-4108-93e2-ac038d211c3d', 'b17b468d-b715-4e7d-b292-7658394ab17f', 'bba5ae14-31f1-4422-b3fd-852098c620b2', '63452226-8359-49d7-ac21-ca439b9d551a'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:34:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:34:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:34:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:33 devstack sudo[111839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:34:33 devstack sudo[111839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:34 devstack sudo[111839]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.258s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:34:34 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] Deleted volume successfully.
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Flow 'volume_create_manager' (d8dc2e65-0227-4712-a729-c48235123e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a19955e-cd17-48b4-a15b-0519ac8ae35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4b84607e-e3a7-4c70-81e3-bd204e8fc2af tempest-TestServerVolumeAttachmentScenario-1840991775 None] Lock "cinder-e52da305-39e1-479f-b09e-06e63b99d9f9-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a19955e-cd17-48b4-a15b-0519ac8ae35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1836735923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76a5bd0-5e01-4133-add2-5d9fa3951767,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='10ea031c9e9746d9acdb952c27fb384d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:34:34Z,use_quota=True,user_id='1782be0a33a447618b2b44d4e7184c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9106b4-3bc1-4783-801b-88eb31ddc1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9106b4-3bc1-4783-801b-88eb31ddc1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3357669e-4b9c-4378-9425-f101fa90bffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3357669e-4b9c-4378-9425-f101fa90bffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b76a5bd0-5e01-4133-add2-5d9fa3951767', 'volume_name': 'volume-b76a5bd0-5e01-4133-add2-5d9fa3951767', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa116c44-98d2-4cde-86f7-c678b4cb8ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa116c44-98d2-4cde-86f7-c678b4cb8ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723e369b-1cc6-4f33-8786-43d85c25a4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:34 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Volume b76a5bd0-5e01-4133-add2-5d9fa3951767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b76a5bd0-5e01-4133-add2-5d9fa3951767', 'volume_size': 1}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1836735923',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b76a5bd0-5e01-4133-add2-5d9fa3951767,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='10ea031c9e9746d9acdb952c27fb384d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:34:34Z,use_quota=True,user_id='1782be0a33a447618b2b44d4e7184c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Creating volume b76a5bd0-5e01-4133-add2-5d9fa3951767 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:34:34 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b76a5bd0-5e01-4133-add2-5d9fa3951767 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:34 devstack sudo[111842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b76a5bd0-5e01-4133-add2-5d9fa3951767 1073741824
Aug 12 16:34:34 devstack sudo[111842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:34 devstack sudo[111842]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b76a5bd0-5e01-4133-add2-5d9fa3951767 1073741824" returned: 0 in 0.451s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b76a5bd0-5e01-4133-add2-5d9fa3951767 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:34 devstack sudo[111848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b76a5bd0-5e01-4133-add2-5d9fa3951767
Aug 12 16:34:34 devstack sudo[111848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:34 devstack sudo[111848]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b76a5bd0-5e01-4133-add2-5d9fa3951767" returned: 0 in 0.277s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723e369b-1cc6-4f33-8786-43d85c25a4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b76a5bd0-5e01-4133-add2-5d9fa3951767', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c5af06-bcd2-40a6-9116-12e3a3463cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:34 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Volume volume-b76a5bd0-5e01-4133-add2-5d9fa3951767 (b76a5bd0-5e01-4133-add2-5d9fa3951767): created successfully
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c5af06-bcd2-40a6-9116-12e3a3463cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Flow 'volume_create_manager' (d8dc2e65-0227-4712-a729-c48235123e93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:34:35 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-44558958-8af8-45d2-a404-79727b961645 tempest-VolumesListTestJSON-686278560 None] Created volume successfully.
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Flow 'volume_create_manager' (76018b7c-eea6-4501-84d0-a7da1a0139e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390eedb2-4be2-4d03-bc1e-c8c92032c47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (390eedb2-4be2-4d03-bc1e-c8c92032c47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1222594954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a36bce-462c-4d2d-be73-613136b733d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='10ea031c9e9746d9acdb952c27fb384d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:34:37Z,use_quota=True,user_id='1782be0a33a447618b2b44d4e7184c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a76c8d6-8188-41e1-b0e7-8f19bc3265da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a76c8d6-8188-41e1-b0e7-8f19bc3265da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9208c6-d745-434e-bccd-15fa362f0322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9208c6-d745-434e-bccd-15fa362f0322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a36bce-462c-4d2d-be73-613136b733d8', 'volume_name': 'volume-c0a36bce-462c-4d2d-be73-613136b733d8', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89a8a85-f8e8-428c-84a0-8848c2f490eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a89a8a85-f8e8-428c-84a0-8848c2f490eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (285d4477-94f0-4cc8-952e-cd02de4b9c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:36 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Volume c0a36bce-462c-4d2d-be73-613136b733d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a36bce-462c-4d2d-be73-613136b733d8', 'volume_size': 1}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1222594954',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a36bce-462c-4d2d-be73-613136b733d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='10ea031c9e9746d9acdb952c27fb384d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:34:37Z,use_quota=True,user_id='1782be0a33a447618b2b44d4e7184c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Creating volume c0a36bce-462c-4d2d-be73-613136b733d8 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:34:36 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:34:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c0a36bce-462c-4d2d-be73-613136b733d8 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:36 devstack sudo[111852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c0a36bce-462c-4d2d-be73-613136b733d8 1073741824
Aug 12 16:34:36 devstack sudo[111852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:37 devstack sudo[111852]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c0a36bce-462c-4d2d-be73-613136b733d8 1073741824" returned: 0 in 0.428s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c0a36bce-462c-4d2d-be73-613136b733d8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:37 devstack sudo[111857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c0a36bce-462c-4d2d-be73-613136b733d8
Aug 12 16:34:37 devstack sudo[111857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:37 devstack sudo[111857]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c0a36bce-462c-4d2d-be73-613136b733d8" returned: 0 in 0.288s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:34:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (285d4477-94f0-4cc8-952e-cd02de4b9c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a36bce-462c-4d2d-be73-613136b733d8', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578883da-31df-458c-adfc-72e65d1fbd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:37 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Volume volume-c0a36bce-462c-4d2d-be73-613136b733d8 (c0a36bce-462c-4d2d-be73-613136b733d8): created successfully
Aug 12 16:34:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578883da-31df-458c-adfc-72e65d1fbd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Flow 'volume_create_manager' (76018b7c-eea6-4501-84d0-a7da1a0139e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:34:37 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c2904ac9-3e2a-49c7-9707-cc59f570c450 tempest-VolumesListTestJSON-686278560 None] Created volume successfully.
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Flow 'volume_create_manager' (73c36f5c-08bf-4907-8fb6-5c141f7dfd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1ee9f9-bac4-441f-8278-9b275125cac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d1ee9f9-bac4-441f-8278-9b275125cac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2142627525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dbceb61-261c-45d6-931c-71011d8e312c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='10ea031c9e9746d9acdb952c27fb384d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:34:39Z,use_quota=True,user_id='1782be0a33a447618b2b44d4e7184c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54dd1123-3eb9-46e8-9a5e-9d1a074fffa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54dd1123-3eb9-46e8-9a5e-9d1a074fffa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43304b74-3ac1-43b4-a763-0b202c86bb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43304b74-3ac1-43b4-a763-0b202c86bb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dbceb61-261c-45d6-931c-71011d8e312c', 'volume_name': 'volume-8dbceb61-261c-45d6-931c-71011d8e312c', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25b0f67-838c-4254-9f6a-c52a0dc3229b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e25b0f67-838c-4254-9f6a-c52a0dc3229b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7938921-0793-4bba-b11c-3c8a3615f68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:39 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Volume 8dbceb61-261c-45d6-931c-71011d8e312c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dbceb61-261c-45d6-931c-71011d8e312c', 'volume_size': 1}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2142627525',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dbceb61-261c-45d6-931c-71011d8e312c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='10ea031c9e9746d9acdb952c27fb384d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:34:39Z,use_quota=True,user_id='1782be0a33a447618b2b44d4e7184c80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Creating volume 8dbceb61-261c-45d6-931c-71011d8e312c {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:34:39 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8dbceb61-261c-45d6-931c-71011d8e312c 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:39 devstack sudo[111862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8dbceb61-261c-45d6-931c-71011d8e312c 1073741824
Aug 12 16:34:39 devstack sudo[111862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:39 devstack sudo[111862]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8dbceb61-261c-45d6-931c-71011d8e312c 1073741824" returned: 0 in 0.443s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8dbceb61-261c-45d6-931c-71011d8e312c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:39 devstack sudo[111869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8dbceb61-261c-45d6-931c-71011d8e312c
Aug 12 16:34:39 devstack sudo[111869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:40 devstack sudo[111869]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8dbceb61-261c-45d6-931c-71011d8e312c" returned: 0 in 0.250s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:34:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7938921-0793-4bba-b11c-3c8a3615f68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dbceb61-261c-45d6-931c-71011d8e312c', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec20fba-9f8d-489b-9f4f-356dd672dc5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:40 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Volume volume-8dbceb61-261c-45d6-931c-71011d8e312c (8dbceb61-261c-45d6-931c-71011d8e312c): created successfully
Aug 12 16:34:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ec20fba-9f8d-489b-9f4f-356dd672dc5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Flow 'volume_create_manager' (73c36f5c-08bf-4907-8fb6-5c141f7dfd92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:34:40 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-3e00f0c0-bbf8-46a4-9228-0b9191000954 tempest-VolumesListTestJSON-686278560 None] Created volume successfully.
Aug 12 16:34:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] Acquiring lock "cinder-8dbceb61-261c-45d6-931c-71011d8e312c-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] Lock "cinder-8dbceb61-261c-45d6-931c-71011d8e312c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] Acquiring lock "cinder-quobyte-8dbceb61-261c-45d6-931c-71011d8e312c" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] Lock "cinder-quobyte-8dbceb61-261c-45d6-931c-71011d8e312c" acquired by "delete_volume" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:42 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6e8a39-3384-4991-a3f4-24cbb03f2ebb]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8dbceb61-261c-45d6-931c-71011d8e312c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:42 devstack sudo[111876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8dbceb61-261c-45d6-931c-71011d8e312c
Aug 12 16:34:42 devstack sudo[111876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:42 devstack sudo[111876]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8dbceb61-261c-45d6-931c-71011d8e312c" returned: 0 in 0.382s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8dbceb61-261c-45d6-931c-71011d8e312c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:42 devstack sudo[111882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8dbceb61-261c-45d6-931c-71011d8e312c
Aug 12 16:34:42 devstack sudo[111882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:43 devstack sudo[111882]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-8dbceb61-261c-45d6-931c-71011d8e312c" returned: 0 in 0.256s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] Lock "cinder-quobyte-8dbceb61-261c-45d6-931c-71011d8e312c" released by "delete_volume" :: held 0.682s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:43 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] Created reservations ['4cc55e05-ff34-462e-8baa-28d299fb1b23', 'cccf0c59-34e0-45d5-b2f8-1fdd240ea4e0', '6ed68587-51c5-46e8-ba59-d76116821a48', '4a95be75-b120-4f45-9a72-ab05144e4ed4'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:34:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:43 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:34:43 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:34:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:43 devstack sudo[111885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:34:43 devstack sudo[111885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:43 devstack sudo[111885]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.270s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:43 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:34:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] Acquiring lock "cinder-c0a36bce-462c-4d2d-be73-613136b733d8-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:43 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] Deleted volume successfully.
Aug 12 16:34:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] Lock "cinder-c0a36bce-462c-4d2d-be73-613136b733d8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-af71e080-0ddd-41ae-8b95-54116dc19077 tempest-VolumesListTestJSON-686278560 None] Lock "cinder-8dbceb61-261c-45d6-931c-71011d8e312c-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] Acquiring lock "cinder-quobyte-c0a36bce-462c-4d2d-be73-613136b733d8" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] Lock "cinder-quobyte-c0a36bce-462c-4d2d-be73-613136b733d8" acquired by "delete_volume" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:43 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e35000-16a0-4061-a543-e5ab4f9d3956]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c0a36bce-462c-4d2d-be73-613136b733d8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:43 devstack sudo[111888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c0a36bce-462c-4d2d-be73-613136b733d8
Aug 12 16:34:43 devstack sudo[111888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:44 devstack sudo[111888]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c0a36bce-462c-4d2d-be73-613136b733d8" returned: 0 in 0.399s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c0a36bce-462c-4d2d-be73-613136b733d8 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:44 devstack sudo[111893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c0a36bce-462c-4d2d-be73-613136b733d8
Aug 12 16:34:44 devstack sudo[111893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:44 devstack sudo[111893]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c0a36bce-462c-4d2d-be73-613136b733d8" returned: 0 in 0.268s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] Lock "cinder-quobyte-c0a36bce-462c-4d2d-be73-613136b733d8" released by "delete_volume" :: held 0.709s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:44 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] Created reservations ['784b1af7-64cd-4de0-a549-0632409e7455', '75fbd029-8603-4238-8ed7-ca861ebc8802', '01e3c194-d90b-4870-a9c0-308f32550d1b', 'c90ea1b4-9a14-486f-b47f-e7417cd31a3d'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:34:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:34:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:34:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:44 devstack sudo[111896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:34:44 devstack sudo[111896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:44 devstack sudo[111896]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.262s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:44 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:34:44 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] Deleted volume successfully.
Aug 12 16:34:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-df15e353-90bd-4f59-947e-ace376297794 tempest-VolumesListTestJSON-686278560 None] Lock "cinder-c0a36bce-462c-4d2d-be73-613136b733d8-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] Acquiring lock "cinder-b76a5bd0-5e01-4133-add2-5d9fa3951767-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] Lock "cinder-b76a5bd0-5e01-4133-add2-5d9fa3951767-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] Acquiring lock "cinder-quobyte-b76a5bd0-5e01-4133-add2-5d9fa3951767" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:34:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] Lock "cinder-quobyte-b76a5bd0-5e01-4133-add2-5d9fa3951767" acquired by "delete_volume" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:34:45 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[be68a288-6b9b-44ff-aa34-7674f98732ef]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:34:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b76a5bd0-5e01-4133-add2-5d9fa3951767 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:45 devstack sudo[111899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b76a5bd0-5e01-4133-add2-5d9fa3951767
Aug 12 16:34:45 devstack sudo[111899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:45 devstack sudo[111899]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b76a5bd0-5e01-4133-add2-5d9fa3951767" returned: 0 in 0.378s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b76a5bd0-5e01-4133-add2-5d9fa3951767 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:45 devstack sudo[111904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b76a5bd0-5e01-4133-add2-5d9fa3951767
Aug 12 16:34:45 devstack sudo[111904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:45 devstack sudo[111904]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b76a5bd0-5e01-4133-add2-5d9fa3951767" returned: 0 in 0.267s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] Lock "cinder-quobyte-b76a5bd0-5e01-4133-add2-5d9fa3951767" released by "delete_volume" :: held 0.691s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:45 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] Created reservations ['8cc3f8d7-386e-4994-b3c9-6899a21f3244', '57236ce9-3e8a-476b-89a1-a86329716ef4', 'e1c03f38-496d-477c-b857-43bc4e38f7f1', 'd91d12c4-5352-4762-8420-137d08a328fa'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:34:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:34:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:34:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:45 devstack sudo[111907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:34:45 devstack sudo[111907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:46 devstack sudo[111907]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.260s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:46 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:34:46 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] Deleted volume successfully.
Aug 12 16:34:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-825f7692-e0c5-4a4d-a5d7-2269fbf15419 tempest-VolumesListTestJSON-686278560 None] Lock "cinder-b76a5bd0-5e01-4133-add2-5d9fa3951767-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Flow 'volume_create_manager' (e94167b2-1981-4765-834c-888372b34300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1164cfe3-39c9-4aaf-8839-ca6c7da870d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1164cfe3-39c9-4aaf-8839-ca6c7da870d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-375388879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2608be-86df-476a-9390-cf1c864711d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eebba3897fa4c119ed28e46596c04c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:34:49Z,use_quota=True,user_id='1bfea5fdbabb4d80bb2aa3d1c46fac49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d514874-f29c-4472-8fb4-fb334f7887e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d514874-f29c-4472-8fb4-fb334f7887e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70782b6f-86fc-4264-9d61-f297ecb0cba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70782b6f-86fc-4264-9d61-f297ecb0cba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af2608be-86df-476a-9390-cf1c864711d9', 'volume_name': 'volume-af2608be-86df-476a-9390-cf1c864711d9', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0636d1e-d49a-4a6b-ab79-0bbd3d85a0e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0636d1e-d49a-4a6b-ab79-0bbd3d85a0e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fed5fb-7ea7-488d-96be-3c74532020f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:49 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Volume af2608be-86df-476a-9390-cf1c864711d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af2608be-86df-476a-9390-cf1c864711d9', 'volume_size': 1}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-375388879',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2608be-86df-476a-9390-cf1c864711d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5eebba3897fa4c119ed28e46596c04c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:34:49Z,use_quota=True,user_id='1bfea5fdbabb4d80bb2aa3d1c46fac49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Creating volume af2608be-86df-476a-9390-cf1c864711d9 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:34:49 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-af2608be-86df-476a-9390-cf1c864711d9 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:49 devstack sudo[111910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-af2608be-86df-476a-9390-cf1c864711d9 1073741824
Aug 12 16:34:49 devstack sudo[111910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:49 devstack sudo[111910]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-af2608be-86df-476a-9390-cf1c864711d9 1073741824" returned: 0 in 0.449s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-af2608be-86df-476a-9390-cf1c864711d9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:34:49 devstack sudo[111916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-af2608be-86df-476a-9390-cf1c864711d9
Aug 12 16:34:49 devstack sudo[111916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:34:49 devstack sudo[111916]: pam_unix(sudo:session): session closed for user root
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-af2608be-86df-476a-9390-cf1c864711d9" returned: 0 in 0.314s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17fed5fb-7ea7-488d-96be-3c74532020f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af2608be-86df-476a-9390-cf1c864711d9', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c550b7-d856-4a6e-9923-6ea151df27aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:34:49 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Volume volume-af2608be-86df-476a-9390-cf1c864711d9 (af2608be-86df-476a-9390-cf1c864711d9): created successfully
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c550b7-d856-4a6e-9923-6ea151df27aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:34:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Flow 'volume_create_manager' (e94167b2-1981-4765-834c-888372b34300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:34:49 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-48c91585-323a-449b-9577-b62d44dcb1e4 tempest-VolumesNegativeTest-1007234606 None] Created volume successfully.
Aug 12 16:34:59 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=131,cinder:INSERT=41,cinder:UPDATE=147,cinder:DELETE=14 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:34:59 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:DELETE=10,cinder:SELECT=128,cinder:INSERT=43,cinder:UPDATE=158 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Flow 'volume_create_manager' (c211ccd8-d3ea-46e4-8dd1-433949c9cf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6133dab-ba7b-4ff4-b3be-c05c912908cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6133dab-ba7b-4ff4-b3be-c05c912908cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1865785101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8ad1bd-09b2-41a0-840c-64cd077506be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa53699a3054480b8d1abc450c5080c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:35:06Z,use_quota=True,user_id='ebb71fb0fdb14d5fadb0f745cc2374a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be54ce7-022e-4bf3-865c-c37169f47ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be54ce7-022e-4bf3-865c-c37169f47ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839c33c9-2c0a-4d21-8990-6716f21adb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839c33c9-2c0a-4d21-8990-6716f21adb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee8ad1bd-09b2-41a0-840c-64cd077506be', 'volume_name': 'volume-ee8ad1bd-09b2-41a0-840c-64cd077506be', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcabed81-00e0-43f2-a8d2-60edbcdcb218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcabed81-00e0-43f2-a8d2-60edbcdcb218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ba5a16-cbbd-4f9a-91ee-0810fd0065fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:06 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Volume ee8ad1bd-09b2-41a0-840c-64cd077506be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee8ad1bd-09b2-41a0-840c-64cd077506be', 'volume_size': 1}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1865785101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8ad1bd-09b2-41a0-840c-64cd077506be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa53699a3054480b8d1abc450c5080c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:35:06Z,use_quota=True,user_id='ebb71fb0fdb14d5fadb0f745cc2374a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Creating volume ee8ad1bd-09b2-41a0-840c-64cd077506be {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:35:06 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:06 devstack sudo[112060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be 1073741824
Aug 12 16:35:06 devstack sudo[112060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:06 devstack sudo[112060]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be 1073741824" returned: 0 in 0.424s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:06 devstack sudo[112066]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be
Aug 12 16:35:06 devstack sudo[112066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:07 devstack sudo[112066]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be" returned: 0 in 0.247s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:35:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ba5a16-cbbd-4f9a-91ee-0810fd0065fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee8ad1bd-09b2-41a0-840c-64cd077506be', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b4232e-9b29-4a62-8680-22e87fba6a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:07 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Volume volume-ee8ad1bd-09b2-41a0-840c-64cd077506be (ee8ad1bd-09b2-41a0-840c-64cd077506be): created successfully
Aug 12 16:35:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b4232e-9b29-4a62-8680-22e87fba6a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Flow 'volume_create_manager' (c211ccd8-d3ea-46e4-8dd1-433949c9cf93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:35:07 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-9221b870-f2a9-4f4c-9fed-66a213a78cee tempest-TestImageHashVerification-664645009 None] Created volume successfully.
Aug 12 16:35:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4b0a08cb-98cb-4e9b-b72c-1ace6cdedbbc tempest-TestImageHashVerification-664645009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4b0a08cb-98cb-4e9b-b72c-1ace6cdedbbc tempest-TestImageHashVerification-664645009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:08 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f5206b-1d67-4f36-81ab-e8ff4006ed0e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4b0a08cb-98cb-4e9b-b72c-1ace6cdedbbc tempest-TestImageHashVerification-664645009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:08 devstack sudo[112071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be
Aug 12 16:35:08 devstack sudo[112071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:08 devstack sudo[112071]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4b0a08cb-98cb-4e9b-b72c-1ace6cdedbbc tempest-TestImageHashVerification-664645009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be" returned: 0 in 0.367s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:08 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[3404d62c-3bf4-46fb-aed0-571b6ee74d99]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4b0a08cb-98cb-4e9b-b72c-1ace6cdedbbc tempest-TestImageHashVerification-664645009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:08 devstack sudo[112076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be
Aug 12 16:35:08 devstack sudo[112076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:08 devstack sudo[112076]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4b0a08cb-98cb-4e9b-b72c-1ace6cdedbbc tempest-TestImageHashVerification-664645009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be" returned: 0 in 0.359s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4b0a08cb-98cb-4e9b-b72c-1ace6cdedbbc tempest-TestImageHashVerification-664645009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be /opt/stack/data/cinder/conversion/ee8ad1bd-09b2-41a0-840c-64cd077506be.temp_image.df9c6779-36f3-4a75-9543-d5e9668a00d1hnjdl56d.img {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:08 devstack sudo[112081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be /opt/stack/data/cinder/conversion/ee8ad1bd-09b2-41a0-840c-64cd077506be.temp_image.df9c6779-36f3-4a75-9543-d5e9668a00d1hnjdl56d.img
Aug 12 16:35:08 devstack sudo[112081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:13 devstack sudo[112081]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4b0a08cb-98cb-4e9b-b72c-1ace6cdedbbc tempest-TestImageHashVerification-664645009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be /opt/stack/data/cinder/conversion/ee8ad1bd-09b2-41a0-840c-64cd077506be.temp_image.df9c6779-36f3-4a75-9543-d5e9668a00d1hnjdl56d.img" returned: 0 in 4.512s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:13 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[379d004e-8426-45be-8aea-ea79a5150b5d]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4b0a08cb-98cb-4e9b-b72c-1ace6cdedbbc tempest-TestImageHashVerification-664645009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:13 devstack sudo[112098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be
Aug 12 16:35:13 devstack sudo[112098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] Acquiring lock "cinder-af2608be-86df-476a-9390-cf1c864711d9-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] Lock "cinder-af2608be-86df-476a-9390-cf1c864711d9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] Acquiring lock "cinder-quobyte-af2608be-86df-476a-9390-cf1c864711d9" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] Lock "cinder-quobyte-af2608be-86df-476a-9390-cf1c864711d9" acquired by "delete_volume" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:13 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8e1749-1228-4d2a-870e-4fc41379ca18]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-af2608be-86df-476a-9390-cf1c864711d9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:13 devstack sudo[112102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-af2608be-86df-476a-9390-cf1c864711d9
Aug 12 16:35:13 devstack sudo[112102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:13 devstack sudo[112098]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4b0a08cb-98cb-4e9b-b72c-1ace6cdedbbc tempest-TestImageHashVerification-664645009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be" returned: 0 in 0.563s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:14 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-4b0a08cb-98cb-4e9b-b72c-1ace6cdedbbc tempest-TestImageHashVerification-664645009 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be, size 1024.00 MB, duration 4.51 sec, destination /opt/stack/data/cinder/conversion/ee8ad1bd-09b2-41a0-840c-64cd077506be.temp_image.df9c6779-36f3-4a75-9543-d5e9668a00d1hnjdl56d.img {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:35:14 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-4b0a08cb-98cb-4e9b-b72c-1ace6cdedbbc tempest-TestImageHashVerification-664645009 None] Converted 1024.00 MB image at 226.85 MB/s
Aug 12 16:35:14 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-4b0a08cb-98cb-4e9b-b72c-1ace6cdedbbc tempest-TestImageHashVerification-664645009 None] df9c6779-36f3-4a75-9543-d5e9668a00d1 was raw, no need to convert to raw {{(pid=94457) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Aug 12 16:35:14 devstack sudo[112102]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-af2608be-86df-476a-9390-cf1c864711d9" returned: 0 in 0.363s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-af2608be-86df-476a-9390-cf1c864711d9 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:14 devstack sudo[112108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-af2608be-86df-476a-9390-cf1c864711d9
Aug 12 16:35:14 devstack sudo[112108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:14 devstack sudo[112108]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-af2608be-86df-476a-9390-cf1c864711d9" returned: 0 in 0.262s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] Lock "cinder-quobyte-af2608be-86df-476a-9390-cf1c864711d9" released by "delete_volume" :: held 0.673s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:14 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] Created reservations ['893a04e4-9d96-4c72-9ff1-4930ed2856a4', '3e01caa4-35c0-46fe-b1e5-c6ec49d49f44', 'b33103f2-0db8-4737-b044-6693b8dffd2d', 'e38ecd53-7b3b-43f9-b153-a7352bb7ccd2'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:35:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:35:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:35:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:14 devstack sudo[112111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:35:14 devstack sudo[112111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:14 devstack sudo[112111]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.269s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:14 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:35:14 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] Deleted volume successfully.
Aug 12 16:35:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-aa10c2be-515d-4dba-a14a-758cca4f6067 tempest-VolumesNegativeTest-1007234606 None] Lock "cinder-af2608be-86df-476a-9390-cf1c864711d9-delete_volume" released by "delete_volume" :: held 1.144s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:17 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:35:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Flow 'volume_create_manager' (570e09c7-5203-43b0-8256-ae7768dddd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:35:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8f64939-5fa2-4130-b884-f8f701b62ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8f64939-5fa2-4130-b884-f8f701b62ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-102236376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0ff169-1782-440b-b228-9d562f4d3766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e460bdb1ba40ef8ff71965bd727c25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:35:18Z,use_quota=True,user_id='32b254187492486d8239d5c318be9525',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffe4dfd-f9db-453f-bff7-373a26118832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffe4dfd-f9db-453f-bff7-373a26118832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62a9526-6d53-48c1-9b8f-8fd8f4fe3632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62a9526-6d53-48c1-9b8f-8fd8f4fe3632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a0ff169-1782-440b-b228-9d562f4d3766', 'volume_name': 'volume-1a0ff169-1782-440b-b228-9d562f4d3766', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56064a63-aaae-4586-ba40-a1d569afa8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56064a63-aaae-4586-ba40-a1d569afa8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:17 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faff77a1-5197-4a89-bc3a-470c7beba4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:17 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Volume 1a0ff169-1782-440b-b228-9d562f4d3766: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a0ff169-1782-440b-b228-9d562f4d3766', 'volume_size': 1}
Aug 12 16:35:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:35:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:35:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:35:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:19 devstack sudo[112114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:35:19 devstack sudo[112114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:19 devstack sudo[112114]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.286s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:35:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:35:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 29 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:35:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>, <Thread(Rabbit-heartbeat, started daemon 134532925736384)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:35:27 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=9,cinder:INSERT=3,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:35:27 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:UPDATE=13,cinder:SELECT=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:35:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4b0a08cb-98cb-4e9b-b72c-1ace6cdedbbc tempest-TestImageHashVerification-664645009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.420s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4b0a08cb-98cb-4e9b-b72c-1ace6cdedbbc tempest-TestImageHashVerification-664645009 None] Uploaded volume to glance image-id: df9c6779-36f3-4a75-9543-d5e9668a00d1. {{(pid=94457) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Aug 12 16:35:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.869s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:35:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-102236376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0ff169-1782-440b-b228-9d562f4d3766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77e460bdb1ba40ef8ff71965bd727c25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:35:18Z,use_quota=True,user_id='32b254187492486d8239d5c318be9525',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:35:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Creating volume 1a0ff169-1782-440b-b228-9d562f4d3766 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:35:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:35:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:35:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:35:32 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:35:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:32 devstack sudo[112155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766 1073741824
Aug 12 16:35:32 devstack sudo[112155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:32 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-4b0a08cb-98cb-4e9b-b72c-1ace6cdedbbc tempest-TestImageHashVerification-664645009 None] Copy volume to image completed successfully.
Aug 12 16:35:33 devstack sudo[112155]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766 1073741824" returned: 0 in 0.428s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:33 devstack sudo[112160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766
Aug 12 16:35:33 devstack sudo[112160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:33 devstack sudo[112160]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766" returned: 0 in 0.262s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faff77a1-5197-4a89-bc3a-470c7beba4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a0ff169-1782-440b-b228-9d562f4d3766', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6731064-99c0-4f31-afed-7df76d8ac3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:33 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Volume volume-1a0ff169-1782-440b-b228-9d562f4d3766 (1a0ff169-1782-440b-b228-9d562f4d3766): created successfully
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6731064-99c0-4f31-afed-7df76d8ac3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Flow 'volume_create_manager' (570e09c7-5203-43b0-8256-ae7768dddd13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:35:33 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-abb182a8-ac6c-4446-ad04-53aa692ba010 tempest-VolumesSnapshotListTestJSON-661878429 None] Created volume successfully.
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] Acquiring lock "cinder-ee8ad1bd-09b2-41a0-840c-64cd077506be-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] Lock "cinder-ee8ad1bd-09b2-41a0-840c-64cd077506be-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] Acquiring lock "cinder-quobyte-ee8ad1bd-09b2-41a0-840c-64cd077506be" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] Lock "cinder-quobyte-ee8ad1bd-09b2-41a0-840c-64cd077506be" acquired by "delete_volume" :: waited 0.019s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cbd75e60-3414-4bd8-86d3-a7e6dde15740 tempest-VolumesSnapshotListTestJSON-661878429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cbd75e60-3414-4bd8-86d3-a7e6dde15740 tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb09c23f-ed1a-4569-a362-3933a20cb0c6]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-cbd75e60-3414-4bd8-86d3-a7e6dde15740 tempest-VolumesSnapshotListTestJSON-661878429 None] Creating offline snapshot a772fd7b-35af-4172-8788-6cafaccd8707 of volume 1a0ff169-1782-440b-b228-9d562f4d3766 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[57770706-98a7-4425-a01b-22f742b66f39]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cbd75e60-3414-4bd8-86d3-a7e6dde15740 tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:33 devstack sudo[112169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be
Aug 12 16:35:33 devstack sudo[112169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:33 devstack sudo[112170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766
Aug 12 16:35:33 devstack sudo[112170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:34 devstack sudo[112169]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be" returned: 0 in 0.373s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:34 devstack sudo[112170]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cbd75e60-3414-4bd8-86d3-a7e6dde15740 tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766" returned: 0 in 0.352s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cbd75e60-3414-4bd8-86d3-a7e6dde15740 tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:34 devstack sudo[112179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be
Aug 12 16:35:34 devstack sudo[112179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:34 devstack sudo[112181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707 1G
Aug 12 16:35:34 devstack sudo[112181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:34 devstack sudo[112179]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ee8ad1bd-09b2-41a0-840c-64cd077506be" returned: 0 in 0.247s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] Lock "cinder-quobyte-ee8ad1bd-09b2-41a0-840c-64cd077506be" released by "delete_volume" :: held 0.663s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] Created reservations ['61509f86-71e5-45b4-b6a9-8527fd192daf', '81181390-26e7-4e97-9fa9-5be93533adf8', '4fc30acb-a0fd-46b4-9f23-203677dabf8e', '2a50211c-9f50-4820-8a35-faaaee6bbe7b'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:34 devstack sudo[112187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:35:34 devstack sudo[112187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:34 devstack sudo[112181]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cbd75e60-3414-4bd8-86d3-a7e6dde15740 tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707 1G" returned: 0 in 0.434s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cbd75e60-3414-4bd8-86d3-a7e6dde15740 tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a0ff169-1782-440b-b228-9d562f4d3766 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:34 devstack sudo[112190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a0ff169-1782-440b-b228-9d562f4d3766 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707
Aug 12 16:35:34 devstack sudo[112190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:34 devstack sudo[112187]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.279s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:35:34 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] Deleted volume successfully.
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ed7ff30b-027c-42b0-a12b-32fa3e940f1c tempest-TestImageHashVerification-664645009 None] Lock "cinder-ee8ad1bd-09b2-41a0-840c-64cd077506be-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:34 devstack sudo[112190]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cbd75e60-3414-4bd8-86d3-a7e6dde15740 tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a0ff169-1782-440b-b228-9d562f4d3766 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707" returned: 0 in 0.324s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:34 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-cbd75e60-3414-4bd8-86d3-a7e6dde15740 tempest-VolumesSnapshotListTestJSON-661878429 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707 is being set with open permissions: ugo+rw
Aug 12 16:35:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cbd75e60-3414-4bd8-86d3-a7e6dde15740 tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:34 devstack sudo[112196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707
Aug 12 16:35:34 devstack sudo[112196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:35 devstack sudo[112196]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cbd75e60-3414-4bd8-86d3-a7e6dde15740 tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707" returned: 0 in 0.250s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cbd75e60-3414-4bd8-86d3-a7e6dde15740 tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:35 devstack sudo[112199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.info
Aug 12 16:35:35 devstack sudo[112199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:35 devstack sudo[112199]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cbd75e60-3414-4bd8-86d3-a7e6dde15740 tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.info" returned: 0 in 0.297s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:35 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-cbd75e60-3414-4bd8-86d3-a7e6dde15740 tempest-VolumesSnapshotListTestJSON-661878429 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.info is being set with open permissions: ugo+rw
Aug 12 16:35:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cbd75e60-3414-4bd8-86d3-a7e6dde15740 tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:35 devstack sudo[112203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.info
Aug 12 16:35:35 devstack sudo[112203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:35 devstack sudo[112203]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cbd75e60-3414-4bd8-86d3-a7e6dde15740 tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.info" returned: 0 in 0.265s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cbd75e60-3414-4bd8-86d3-a7e6dde15740 tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.029s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:35 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-cbd75e60-3414-4bd8-86d3-a7e6dde15740 tempest-VolumesSnapshotListTestJSON-661878429 None] Create snapshot completed successfully
Aug 12 16:35:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8661cc13-a783-46a8-8e77-9b634c52fea4 tempest-VolumesSnapshotListTestJSON-661878429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8661cc13-a783-46a8-8e77-9b634c52fea4 tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-8661cc13-a783-46a8-8e77-9b634c52fea4 tempest-VolumesSnapshotListTestJSON-661878429 None] Creating offline snapshot fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d of volume 1a0ff169-1782-440b-b228-9d562f4d3766 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:35:37 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2de7a7-16b4-4765-8346-8d9556a41dd6]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8661cc13-a783-46a8-8e77-9b634c52fea4 tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:37 devstack sudo[112207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707
Aug 12 16:35:37 devstack sudo[112207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:37 devstack sudo[112207]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8661cc13-a783-46a8-8e77-9b634c52fea4 tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707" returned: 0 in 0.350s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-8661cc13-a783-46a8-8e77-9b634c52fea4 tempest-VolumesSnapshotListTestJSON-661878429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a0ff169-1782-440b-b228-9d562f4d3766(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:35:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8661cc13-a783-46a8-8e77-9b634c52fea4 tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:37 devstack sudo[112212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d 1G
Aug 12 16:35:37 devstack sudo[112212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:37 devstack sudo[112212]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8661cc13-a783-46a8-8e77-9b634c52fea4 tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d 1G" returned: 0 in 0.424s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8661cc13-a783-46a8-8e77-9b634c52fea4 tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:37 devstack sudo[112217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d
Aug 12 16:35:37 devstack sudo[112217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:38 devstack sudo[112217]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8661cc13-a783-46a8-8e77-9b634c52fea4 tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d" returned: 0 in 0.349s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:38 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-8661cc13-a783-46a8-8e77-9b634c52fea4 tempest-VolumesSnapshotListTestJSON-661878429 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d is being set with open permissions: ugo+rw
Aug 12 16:35:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8661cc13-a783-46a8-8e77-9b634c52fea4 tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:38 devstack sudo[112224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d
Aug 12 16:35:38 devstack sudo[112224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:38 devstack sudo[112224]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8661cc13-a783-46a8-8e77-9b634c52fea4 tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d" returned: 0 in 0.254s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8661cc13-a783-46a8-8e77-9b634c52fea4 tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.479s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:38 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-8661cc13-a783-46a8-8e77-9b634c52fea4 tempest-VolumesSnapshotListTestJSON-661878429 None] Create snapshot completed successfully
Aug 12 16:35:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f01dd7ce-9321-411a-ae3a-c73f0665c28f tempest-VolumesSnapshotListTestJSON-661878429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f01dd7ce-9321-411a-ae3a-c73f0665c28f tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-f01dd7ce-9321-411a-ae3a-c73f0665c28f tempest-VolumesSnapshotListTestJSON-661878429 None] Creating offline snapshot d561d80e-d04b-4b6f-883b-f480f7b22730 of volume 1a0ff169-1782-440b-b228-9d562f4d3766 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:35:39 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85c5bb2-06a7-45bb-b028-d6022536ed1f]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f01dd7ce-9321-411a-ae3a-c73f0665c28f tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:39 devstack sudo[112228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d
Aug 12 16:35:39 devstack sudo[112228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:39 devstack sudo[112228]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f01dd7ce-9321-411a-ae3a-c73f0665c28f tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d" returned: 0 in 0.362s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-f01dd7ce-9321-411a-ae3a-c73f0665c28f tempest-VolumesSnapshotListTestJSON-661878429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a0ff169-1782-440b-b228-9d562f4d3766(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:35:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f01dd7ce-9321-411a-ae3a-c73f0665c28f tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:39 devstack sudo[112233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730 1G
Aug 12 16:35:39 devstack sudo[112233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:40 devstack sudo[112233]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f01dd7ce-9321-411a-ae3a-c73f0665c28f tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730 1G" returned: 0 in 0.488s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f01dd7ce-9321-411a-ae3a-c73f0665c28f tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:40 devstack sudo[112241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730
Aug 12 16:35:40 devstack sudo[112241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:40 devstack sudo[112241]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f01dd7ce-9321-411a-ae3a-c73f0665c28f tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730" returned: 0 in 0.303s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:40 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-f01dd7ce-9321-411a-ae3a-c73f0665c28f tempest-VolumesSnapshotListTestJSON-661878429 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730 is being set with open permissions: ugo+rw
Aug 12 16:35:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f01dd7ce-9321-411a-ae3a-c73f0665c28f tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:40 devstack sudo[112248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730
Aug 12 16:35:40 devstack sudo[112248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:40 devstack sudo[112248]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f01dd7ce-9321-411a-ae3a-c73f0665c28f tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730" returned: 0 in 0.248s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f01dd7ce-9321-411a-ae3a-c73f0665c28f tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.496s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:40 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-f01dd7ce-9321-411a-ae3a-c73f0665c28f tempest-VolumesSnapshotListTestJSON-661878429 None] Create snapshot completed successfully
Aug 12 16:35:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] Acquiring lock "cinder-d561d80e-d04b-4b6f-883b-f480f7b22730-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-d561d80e-d04b-4b6f-883b-f480f7b22730-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] Acquiring lock "cinder-quobyte-1a0ff169-1782-440b-b228-9d562f4d3766" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-quobyte-1a0ff169-1782-440b-b228-9d562f4d3766" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] Acquiring lock "cinder-quobyte-d561d80e-d04b-4b6f-883b-f480f7b22730" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-quobyte-d561d80e-d04b-4b6f-883b-f480f7b22730" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] Deleting offline snapshot d561d80e-d04b-4b6f-883b-f480f7b22730 of volume 1a0ff169-1782-440b-b228-9d562f4d3766 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:35:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] snapshot_file for this snap is: volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:35:42 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de6de78-ccf3-4eb7-ad1e-0a902c2cb60e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:42 devstack sudo[112252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730
Aug 12 16:35:42 devstack sudo[112252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:42 devstack sudo[112252]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730" returned: 0 in 0.389s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a0ff169-1782-440b-b228-9d562f4d3766(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:35:42 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ec4b10-8b69-4af1-9dd2-b88ea3c24e4f]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:42 devstack sudo[112257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d
Aug 12 16:35:42 devstack sudo[112257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:43 devstack sudo[112257]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d" returned: 0 in 0.400s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:43 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a0ff169-1782-440b-b228-9d562f4d3766(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:35:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:43 devstack sudo[112263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730
Aug 12 16:35:43 devstack sudo[112263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:43 devstack sudo[112263]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730" returned: 0 in 0.447s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:43 devstack sudo[112268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730
Aug 12 16:35:43 devstack sudo[112268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:43 devstack sudo[112268]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.d561d80e-d04b-4b6f-883b-f480f7b22730" returned: 0 in 0.264s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-quobyte-d561d80e-d04b-4b6f-883b-f480f7b22730" released by "_delete_snapshot" :: held 1.602s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-quobyte-1a0ff169-1782-440b-b228-9d562f4d3766" released by "delete_snapshot" :: held 1.628s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:43 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] Created reservations ['3c450e1a-598c-4f1f-a292-cca113180b94', 'ca3952dc-693e-484c-875c-2bc0844b3cdf', '14cd7881-999a-4f26-bab2-ea26ad142dc5', '81d98d36-fea1-4521-85c8-ba2840a1d230'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:35:43 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] Delete snapshot completed successfully.
Aug 12 16:35:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e5f1ecb4-ef59-47c9-bcff-443733a1e1ad tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-d561d80e-d04b-4b6f-883b-f480f7b22730-delete_snapshot" released by "delete_snapshot" :: held 1.770s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] Acquiring lock "cinder-fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] Acquiring lock "cinder-quobyte-1a0ff169-1782-440b-b228-9d562f4d3766" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-quobyte-1a0ff169-1782-440b-b228-9d562f4d3766" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] Acquiring lock "cinder-quobyte-fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-quobyte-fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] Deleting offline snapshot fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d of volume 1a0ff169-1782-440b-b228-9d562f4d3766 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:35:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] snapshot_file for this snap is: volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:35:44 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e55ed2-99fd-4435-b72d-f9011aa6a263]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:44 devstack sudo[112271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d
Aug 12 16:35:44 devstack sudo[112271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:44 devstack sudo[112271]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d" returned: 0 in 0.384s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a0ff169-1782-440b-b228-9d562f4d3766(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:35:44 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a14746-84d7-4a21-be38-183b0824f0cf]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:45 devstack sudo[112276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707
Aug 12 16:35:45 devstack sudo[112276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:45 devstack sudo[112276]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707" returned: 0 in 0.369s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a0ff169-1782-440b-b228-9d562f4d3766(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:35:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:45 devstack sudo[112281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d
Aug 12 16:35:45 devstack sudo[112281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:45 devstack sudo[112281]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d" returned: 0 in 0.400s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:45 devstack sudo[112286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d
Aug 12 16:35:45 devstack sudo[112286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:45 devstack sudo[112286]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d" returned: 0 in 0.245s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-quobyte-fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d" released by "_delete_snapshot" :: held 1.499s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-quobyte-1a0ff169-1782-440b-b228-9d562f4d3766" released by "delete_snapshot" :: held 1.519s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] Created reservations ['0e553c5b-f83a-4452-8cec-5befad6e7b22', 'd45affdb-2e97-4f48-ba08-535bcda6718c', '5245eb02-1636-47ec-b671-4da9784afcfa', '0236bff0-7c8a-4dc4-9757-82827485a876'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:35:46 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] Delete snapshot completed successfully.
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8b863295-dd0f-45c7-9b2b-95bf4fec98f2 tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-fe00c1c4-be1a-42b4-b0f1-a3c9e0f2b83d-delete_snapshot" released by "delete_snapshot" :: held 1.664s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Flow 'volume_create_manager' (02df3199-f8a8-4088-9abb-e0172e37b01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd42b40-c224-45f4-a026-f1e423d54739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddd42b40-c224-45f4-a026-f1e423d54739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2016978245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335aa57d-5ddb-4f9c-96d6-941c61a095dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e46a2a35ef3440692077808e32d1004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:35:46Z,use_quota=True,user_id='a3ef900181be4bb6b6171fe7deab449b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edecd66b-9b0f-43c2-8363-4e28994cc5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edecd66b-9b0f-43c2-8363-4e28994cc5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db489dbd-9bdb-45fd-b977-53996a38b516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db489dbd-9bdb-45fd-b977-53996a38b516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '335aa57d-5ddb-4f9c-96d6-941c61a095dc', 'volume_name': 'volume-335aa57d-5ddb-4f9c-96d6-941c61a095dc', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e982738-b1e9-44a1-b1c5-42c66f6ec142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e982738-b1e9-44a1-b1c5-42c66f6ec142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ac1fd4-6f76-4581-81be-65a58499cfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:46 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Volume 335aa57d-5ddb-4f9c-96d6-941c61a095dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-335aa57d-5ddb-4f9c-96d6-941c61a095dc', 'volume_size': 1}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:35:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2016978245',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=335aa57d-5ddb-4f9c-96d6-941c61a095dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e46a2a35ef3440692077808e32d1004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:35:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:35:46Z,use_quota=True,user_id='a3ef900181be4bb6b6171fe7deab449b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Creating volume 335aa57d-5ddb-4f9c-96d6-941c61a095dc {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:35:46 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-335aa57d-5ddb-4f9c-96d6-941c61a095dc 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:46 devstack sudo[112289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-335aa57d-5ddb-4f9c-96d6-941c61a095dc 1073741824
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] Acquiring lock "cinder-a772fd7b-35af-4172-8788-6cafaccd8707-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:46 devstack sudo[112289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-a772fd7b-35af-4172-8788-6cafaccd8707-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] Acquiring lock "cinder-quobyte-1a0ff169-1782-440b-b228-9d562f4d3766" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-quobyte-1a0ff169-1782-440b-b228-9d562f4d3766" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] Acquiring lock "cinder-quobyte-a772fd7b-35af-4172-8788-6cafaccd8707" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-quobyte-a772fd7b-35af-4172-8788-6cafaccd8707" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] Deleting offline snapshot a772fd7b-35af-4172-8788-6cafaccd8707 of volume 1a0ff169-1782-440b-b228-9d562f4d3766 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] snapshot_file for this snap is: volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e8ace8-b42c-4e6d-8f38-38f017cfd30a]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:46 devstack sudo[112291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707
Aug 12 16:35:46 devstack sudo[112291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:46 devstack sudo[112289]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-335aa57d-5ddb-4f9c-96d6-941c61a095dc 1073741824" returned: 0 in 0.434s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-335aa57d-5ddb-4f9c-96d6-941c61a095dc {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:47 devstack sudo[112299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-335aa57d-5ddb-4f9c-96d6-941c61a095dc
Aug 12 16:35:47 devstack sudo[112299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:47 devstack sudo[112291]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707" returned: 0 in 0.398s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a0ff169-1782-440b-b228-9d562f4d3766(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfb7174-1116-4d52-9232-076db1e2d425]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:47 devstack sudo[112301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766
Aug 12 16:35:47 devstack sudo[112301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:47 devstack sudo[112299]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-335aa57d-5ddb-4f9c-96d6-941c61a095dc" returned: 0 in 0.259s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ac1fd4-6f76-4581-81be-65a58499cfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-335aa57d-5ddb-4f9c-96d6-941c61a095dc', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685da7ba-8095-4701-ba65-6c60123b62d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:47 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Volume volume-335aa57d-5ddb-4f9c-96d6-941c61a095dc (335aa57d-5ddb-4f9c-96d6-941c61a095dc): created successfully
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (685da7ba-8095-4701-ba65-6c60123b62d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Flow 'volume_create_manager' (02df3199-f8a8-4088-9abb-e0172e37b01c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:35:47 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-fec242d4-efb5-43d9-9420-4938b24a1d16 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Created volume successfully.
Aug 12 16:35:47 devstack sudo[112301]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766" returned: 0 in 0.378s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:47 devstack sudo[112307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707
Aug 12 16:35:47 devstack sudo[112307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:47 devstack sudo[112307]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707" returned: 0 in 0.376s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:47 devstack sudo[112313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707
Aug 12 16:35:47 devstack sudo[112313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Flow 'volume_create_manager' (ad911900-a318-4282-852f-3cd2f38d2ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438dc84b-7d3e-40a5-b495-e614af31db81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438dc84b-7d3e-40a5-b495-e614af31db81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-764275743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef5027c-00ce-47b7-8621-2d0549330204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e46a2a35ef3440692077808e32d1004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:35:48Z,use_quota=True,user_id='a3ef900181be4bb6b6171fe7deab449b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1a2f49-594e-426a-8749-1f72971c8d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd1a2f49-594e-426a-8749-1f72971c8d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c3b79f-3afb-42c4-ac92-795101e1753d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1c3b79f-3afb-42c4-ac92-795101e1753d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cef5027c-00ce-47b7-8621-2d0549330204', 'volume_name': 'volume-cef5027c-00ce-47b7-8621-2d0549330204', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec81e56b-4195-400c-89aa-8bb873e9eab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec81e56b-4195-400c-89aa-8bb873e9eab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05365bd3-500f-48e6-a432-447a168c7dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:48 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Volume cef5027c-00ce-47b7-8621-2d0549330204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cef5027c-00ce-47b7-8621-2d0549330204', 'volume_size': 1}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-764275743',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef5027c-00ce-47b7-8621-2d0549330204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e46a2a35ef3440692077808e32d1004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:35:48Z,use_quota=True,user_id='a3ef900181be4bb6b6171fe7deab449b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Creating volume cef5027c-00ce-47b7-8621-2d0549330204 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:35:48 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cef5027c-00ce-47b7-8621-2d0549330204 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:48 devstack sudo[112315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cef5027c-00ce-47b7-8621-2d0549330204 1073741824
Aug 12 16:35:48 devstack sudo[112315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:48 devstack sudo[112313]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766.a772fd7b-35af-4172-8788-6cafaccd8707" returned: 0 in 0.300s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-quobyte-a772fd7b-35af-4172-8788-6cafaccd8707" released by "_delete_snapshot" :: held 1.585s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-quobyte-1a0ff169-1782-440b-b228-9d562f4d3766" released by "delete_snapshot" :: held 1.608s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] Created reservations ['01ad6254-4eac-40e8-889d-40417afd8616', '5d94cc33-dac2-4d23-8e58-148021d49348', 'eaabea44-6388-4917-9401-b9cb46331532', 'fe7ac0c6-1958-4bf6-a5f5-26bdfd61605d'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Flow 'volume_create_manager' (119389ac-7788-40ba-8f0e-d57e568f0a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52b0281-2a03-40cf-a022-6fc4c4406da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52b0281-2a03-40cf-a022-6fc4c4406da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-949152079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e87c4a2-8719-425d-b526-94bbd1120274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e46a2a35ef3440692077808e32d1004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:35:48Z,use_quota=True,user_id='a3ef900181be4bb6b6171fe7deab449b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db42e1a-ce79-44c1-bfb8-e4f3161fb3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7db42e1a-ce79-44c1-bfb8-e4f3161fb3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a227dfe4-052e-4e46-a1a7-d88f82bcc78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a227dfe4-052e-4e46-a1a7-d88f82bcc78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e87c4a2-8719-425d-b526-94bbd1120274', 'volume_name': 'volume-5e87c4a2-8719-425d-b526-94bbd1120274', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b627575-6362-4c2c-b1a5-0fae029fc6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b627575-6362-4c2c-b1a5-0fae029fc6c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03549409-8e4d-473b-9e96-2fdc30c63e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:48 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Volume 5e87c4a2-8719-425d-b526-94bbd1120274: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e87c4a2-8719-425d-b526-94bbd1120274', 'volume_size': 1}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:48 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] Delete snapshot completed successfully.
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-51fe8caa-8e89-4185-b790-c21fbe57850f tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-a772fd7b-35af-4172-8788-6cafaccd8707-delete_snapshot" released by "delete_snapshot" :: held 1.929s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:48 devstack sudo[112315]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cef5027c-00ce-47b7-8621-2d0549330204 1073741824" returned: 0 in 0.559s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cef5027c-00ce-47b7-8621-2d0549330204 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:48 devstack sudo[112321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cef5027c-00ce-47b7-8621-2d0549330204
Aug 12 16:35:48 devstack sudo[112321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] Acquiring lock "cinder-1a0ff169-1782-440b-b228-9d562f4d3766-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-1a0ff169-1782-440b-b228-9d562f4d3766-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:48 devstack sudo[112321]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cef5027c-00ce-47b7-8621-2d0549330204" returned: 0 in 0.307s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.456s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:35:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-949152079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e87c4a2-8719-425d-b526-94bbd1120274,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e46a2a35ef3440692077808e32d1004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:35:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:35:48Z,use_quota=True,user_id='a3ef900181be4bb6b6171fe7deab449b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Creating volume 5e87c4a2-8719-425d-b526-94bbd1120274 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:35:48 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e87c4a2-8719-425d-b526-94bbd1120274 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:48 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Flow 'volume_create_manager' (c8c636d4-7a1a-43ad-8fc8-2f723ab253df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:35:49 devstack sudo[112324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e87c4a2-8719-425d-b526-94bbd1120274 1073741824
Aug 12 16:35:49 devstack sudo[112324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca92ad6-1be3-4de1-bfcd-353edb868a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05365bd3-500f-48e6-a432-447a168c7dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef5027c-00ce-47b7-8621-2d0549330204', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ebea828-ecfd-445c-b13c-f105d096be3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca92ad6-1be3-4de1-bfcd-353edb868a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-600909853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a398a0-1d57-43dd-b367-fa1f1203057a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e46a2a35ef3440692077808e32d1004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:35:49Z,use_quota=True,user_id='a3ef900181be4bb6b6171fe7deab449b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa2dfc27-c9aa-46aa-a27f-2d3234c350ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa2dfc27-c9aa-46aa-a27f-2d3234c350ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c65f975-c9c5-4a6c-9125-141df855955b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c65f975-c9c5-4a6c-9125-141df855955b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5a398a0-1d57-43dd-b367-fa1f1203057a', 'volume_name': 'volume-d5a398a0-1d57-43dd-b367-fa1f1203057a', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3564591-6885-4684-8e0a-e7101d9019cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3564591-6885-4684-8e0a-e7101d9019cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b385c7c-a8db-42f5-a38d-aa557386770b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:49 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Volume d5a398a0-1d57-43dd-b367-fa1f1203057a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5a398a0-1d57-43dd-b367-fa1f1203057a', 'volume_size': 1}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] Acquiring lock "cinder-quobyte-1a0ff169-1782-440b-b228-9d562f4d3766" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:49 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Volume volume-cef5027c-00ce-47b7-8621-2d0549330204 (cef5027c-00ce-47b7-8621-2d0549330204): created successfully
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ebea828-ecfd-445c-b13c-f105d096be3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Flow 'volume_create_manager' (ad911900-a318-4282-852f-3cd2f38d2ff2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-quobyte-1a0ff169-1782-440b-b228-9d562f4d3766" acquired by "delete_volume" :: waited 0.028s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:49 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-904cf74f-f73a-418f-a9a6-5a7bd25a0028 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Created volume successfully.
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6ff6cb-d433-4155-83ff-f01072ec704e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Flow 'volume_create_manager' (362f47ae-3aa4-4d2a-937a-4d0d3400e82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c231145-e1c1-4001-93b9-60eeba704614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:49 devstack sudo[112326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766
Aug 12 16:35:49 devstack sudo[112326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c231145-e1c1-4001-93b9-60eeba704614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-866656667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef53f1a-343a-402c-aa2a-662003f39625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e46a2a35ef3440692077808e32d1004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:35:49Z,use_quota=True,user_id='a3ef900181be4bb6b6171fe7deab449b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cce628e-5d2f-4902-8152-01ea43984517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cce628e-5d2f-4902-8152-01ea43984517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fae323-2dde-4d11-bd07-3ad75f8a486d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09fae323-2dde-4d11-bd07-3ad75f8a486d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef53f1a-343a-402c-aa2a-662003f39625', 'volume_name': 'volume-fef53f1a-343a-402c-aa2a-662003f39625', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73b008f-38d2-49a1-a811-f7e7b02af1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f73b008f-38d2-49a1-a811-f7e7b02af1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3fbda1-4865-48cb-90bf-ef9f60c8d5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:49 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Volume fef53f1a-343a-402c-aa2a-662003f39625: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef53f1a-343a-402c-aa2a-662003f39625', 'volume_size': 1}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:49 devstack sudo[112324]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e87c4a2-8719-425d-b526-94bbd1120274 1073741824" returned: 0 in 0.634s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e87c4a2-8719-425d-b526-94bbd1120274 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:35:49 devstack sudo[112326]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:49 devstack sudo[112335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e87c4a2-8719-425d-b526-94bbd1120274
Aug 12 16:35:49 devstack sudo[112335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Flow 'volume_create_manager' (dcbf3dd2-b1f4-4e4c-9f10-69af3235d10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602204b2-d5f6-4c3e-b67f-98bdb4afd133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766" returned: 0 in 0.538s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:49 devstack sudo[112337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602204b2-d5f6-4c3e-b67f-98bdb4afd133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1387156424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7a0cc2-dbc1-4955-b177-581c8892668e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e46a2a35ef3440692077808e32d1004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:35:50Z,use_quota=True,user_id='a3ef900181be4bb6b6171fe7deab449b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:49 devstack sudo[112337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a25b99-437d-4acc-b68e-b47ed0f20613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a25b99-437d-4acc-b68e-b47ed0f20613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (452cac29-5600-4d2d-b083-936564347cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (452cac29-5600-4d2d-b083-936564347cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f7a0cc2-dbc1-4955-b177-581c8892668e', 'volume_name': 'volume-1f7a0cc2-dbc1-4955-b177-581c8892668e', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d75f536-269c-43a1-85fe-c2aa44a57288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d75f536-269c-43a1-85fe-c2aa44a57288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28c4da1-f35f-4345-81c3-d6f1aa170827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:49 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Volume 1f7a0cc2-dbc1-4955-b177-581c8892668e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f7a0cc2-dbc1-4955-b177-581c8892668e', 'volume_size': 1}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:49 devstack sudo[112335]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e87c4a2-8719-425d-b526-94bbd1120274" returned: 0 in 0.254s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.834s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-600909853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a398a0-1d57-43dd-b367-fa1f1203057a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e46a2a35ef3440692077808e32d1004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:35:49Z,use_quota=True,user_id='a3ef900181be4bb6b6171fe7deab449b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Creating volume d5a398a0-1d57-43dd-b367-fa1f1203057a {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:35:49 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d5a398a0-1d57-43dd-b367-fa1f1203057a 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03549409-8e4d-473b-9e96-2fdc30c63e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e87c4a2-8719-425d-b526-94bbd1120274', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:49 devstack sudo[112341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d5a398a0-1d57-43dd-b367-fa1f1203057a 1073741824
Aug 12 16:35:49 devstack sudo[112341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c3c856-6908-4beb-a059-c2a9d7b09567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:49 devstack sudo[112337]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1a0ff169-1782-440b-b228-9d562f4d3766" returned: 0 in 0.266s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:49 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Volume volume-5e87c4a2-8719-425d-b526-94bbd1120274 (5e87c4a2-8719-425d-b526-94bbd1120274): created successfully
Aug 12 16:35:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c3c856-6908-4beb-a059-c2a9d7b09567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Flow 'volume_create_manager' (119389ac-7788-40ba-8f0e-d57e568f0a6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-quobyte-1a0ff169-1782-440b-b228-9d562f4d3766" released by "delete_volume" :: held 0.890s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:50 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-81a7c6b2-0490-4877-bdc8-c405e8c40bd2 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Created volume successfully.
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] Created reservations ['ad0d7c81-8d93-4f5e-8e8c-418aa136e2db', '89f7d848-1daa-4403-98ff-be7dfa11b181', '137e3dec-5240-4376-8378-d3e6a0b82165', '5a69168a-f076-443c-a231-4c1fb944f8dd'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:50 devstack sudo[112343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:35:50 devstack sudo[112343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:50 devstack sudo[112341]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d5a398a0-1d57-43dd-b367-fa1f1203057a 1073741824" returned: 0 in 0.449s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:50 devstack sudo[112343]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.276s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:35:50 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] Deleted volume successfully.
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d5a398a0-1d57-43dd-b367-fa1f1203057a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1a7f8232-a727-4850-8598-8e1617d33d7b tempest-VolumesSnapshotListTestJSON-661878429 None] Lock "cinder-1a0ff169-1782-440b-b228-9d562f4d3766-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:50 devstack sudo[112351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d5a398a0-1d57-43dd-b367-fa1f1203057a
Aug 12 16:35:50 devstack sudo[112351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:50 devstack sudo[112351]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d5a398a0-1d57-43dd-b367-fa1f1203057a" returned: 0 in 0.247s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.261s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-866656667',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef53f1a-343a-402c-aa2a-662003f39625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e46a2a35ef3440692077808e32d1004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:35:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:35:49Z,use_quota=True,user_id='a3ef900181be4bb6b6171fe7deab449b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Creating volume fef53f1a-343a-402c-aa2a-662003f39625 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:35:50 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fef53f1a-343a-402c-aa2a-662003f39625 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:50 devstack sudo[112354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fef53f1a-343a-402c-aa2a-662003f39625 1073741824
Aug 12 16:35:50 devstack sudo[112354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b385c7c-a8db-42f5-a38d-aa557386770b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5a398a0-1d57-43dd-b367-fa1f1203057a', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d11849-9520-47a1-8b73-7e4b6b29bcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:50 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Volume volume-d5a398a0-1d57-43dd-b367-fa1f1203057a (d5a398a0-1d57-43dd-b367-fa1f1203057a): created successfully
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24d11849-9520-47a1-8b73-7e4b6b29bcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Flow 'volume_create_manager' (c8c636d4-7a1a-43ad-8fc8-2f723ab253df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:35:50 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-4d4ba7a5-8b81-4b78-be80-e412e9f30796 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Created volume successfully.
Aug 12 16:35:51 devstack sudo[112354]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fef53f1a-343a-402c-aa2a-662003f39625 1073741824" returned: 0 in 0.407s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fef53f1a-343a-402c-aa2a-662003f39625 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:51 devstack sudo[112360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fef53f1a-343a-402c-aa2a-662003f39625
Aug 12 16:35:51 devstack sudo[112360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:51 devstack sudo[112360]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fef53f1a-343a-402c-aa2a-662003f39625" returned: 0 in 0.260s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.608s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1387156424',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f7a0cc2-dbc1-4955-b177-581c8892668e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e46a2a35ef3440692077808e32d1004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:35:50Z,use_quota=True,user_id='a3ef900181be4bb6b6171fe7deab449b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Creating volume 1f7a0cc2-dbc1-4955-b177-581c8892668e {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:35:51 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1f7a0cc2-dbc1-4955-b177-581c8892668e 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c3fbda1-4865-48cb-90bf-ef9f60c8d5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef53f1a-343a-402c-aa2a-662003f39625', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:51 devstack sudo[112363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1f7a0cc2-dbc1-4955-b177-581c8892668e 1073741824
Aug 12 16:35:51 devstack sudo[112363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f505e5b-d252-4baf-8f43-f3437d54fa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:51 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Volume volume-fef53f1a-343a-402c-aa2a-662003f39625 (fef53f1a-343a-402c-aa2a-662003f39625): created successfully
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f505e5b-d252-4baf-8f43-f3437d54fa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Flow 'volume_create_manager' (362f47ae-3aa4-4d2a-937a-4d0d3400e82a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:35:51 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5cdc2c08-e20a-430a-944d-0204be40236a tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Created volume successfully.
Aug 12 16:35:51 devstack sudo[112363]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1f7a0cc2-dbc1-4955-b177-581c8892668e 1073741824" returned: 0 in 0.495s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1f7a0cc2-dbc1-4955-b177-581c8892668e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:51 devstack sudo[112368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1f7a0cc2-dbc1-4955-b177-581c8892668e
Aug 12 16:35:51 devstack sudo[112368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:52 devstack sudo[112368]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1f7a0cc2-dbc1-4955-b177-581c8892668e" returned: 0 in 0.262s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:52 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:35:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:52 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28c4da1-f35f-4345-81c3-d6f1aa170827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f7a0cc2-dbc1-4955-b177-581c8892668e', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:52 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2639f468-7a12-4f8a-806b-65d7bb3e6912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:35:52 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Volume volume-1f7a0cc2-dbc1-4955-b177-581c8892668e (1f7a0cc2-dbc1-4955-b177-581c8892668e): created successfully
Aug 12 16:35:52 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2639f468-7a12-4f8a-806b-65d7bb3e6912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:35:52 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Flow 'volume_create_manager' (dcbf3dd2-b1f4-4e4c-9f10-69af3235d10f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:35:52 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-25bab67b-8968-4ce2-ae94-d60aef961ff1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Created volume successfully.
Aug 12 16:35:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "cinder-1f7a0cc2-dbc1-4955-b177-581c8892668e-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-1f7a0cc2-dbc1-4955-b177-581c8892668e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "cinder-quobyte-1f7a0cc2-dbc1-4955-b177-581c8892668e" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-quobyte-1f7a0cc2-dbc1-4955-b177-581c8892668e" acquired by "delete_volume" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:53 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e30b5e-e4ef-4add-b490-5171a4dab555]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1f7a0cc2-dbc1-4955-b177-581c8892668e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:53 devstack sudo[112371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1f7a0cc2-dbc1-4955-b177-581c8892668e
Aug 12 16:35:53 devstack sudo[112371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:53 devstack sudo[112371]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1f7a0cc2-dbc1-4955-b177-581c8892668e" returned: 0 in 0.388s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1f7a0cc2-dbc1-4955-b177-581c8892668e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:53 devstack sudo[112376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1f7a0cc2-dbc1-4955-b177-581c8892668e
Aug 12 16:35:53 devstack sudo[112376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:53 devstack sudo[112376]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1f7a0cc2-dbc1-4955-b177-581c8892668e" returned: 0 in 0.280s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-quobyte-1f7a0cc2-dbc1-4955-b177-581c8892668e" released by "delete_volume" :: held 0.710s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:53 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Created reservations ['089e5ccd-71f3-4b13-8afe-cc69fbe8cef9', '5f1172a7-c3e4-4103-8f16-f7d63e5cbee5', '2b0319c1-161b-4db8-9d48-8e2e0b10e373', '35b3eba9-d3b3-4e27-8f5d-af0a8cadadbe'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:35:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:53 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:35:54 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:35:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:54 devstack sudo[112379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:35:54 devstack sudo[112379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:54 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "cinder-fef53f1a-343a-402c-aa2a-662003f39625-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:54 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-fef53f1a-343a-402c-aa2a-662003f39625-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:54 devstack sudo[112379]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.327s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:54 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:35:54 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Deleted volume successfully.
Aug 12 16:35:54 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cf9d0255-466f-43e9-bb9b-60f0ac929c25 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-1f7a0cc2-dbc1-4955-b177-581c8892668e-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:54 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "cinder-quobyte-fef53f1a-343a-402c-aa2a-662003f39625" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:54 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-quobyte-fef53f1a-343a-402c-aa2a-662003f39625" acquired by "delete_volume" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:54 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19f22cf-f6f4-49fb-b765-df4f79dfdf57]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fef53f1a-343a-402c-aa2a-662003f39625 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:54 devstack sudo[112382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fef53f1a-343a-402c-aa2a-662003f39625
Aug 12 16:35:54 devstack sudo[112382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:54 devstack sudo[112382]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fef53f1a-343a-402c-aa2a-662003f39625" returned: 0 in 0.417s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fef53f1a-343a-402c-aa2a-662003f39625 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:54 devstack sudo[112387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fef53f1a-343a-402c-aa2a-662003f39625
Aug 12 16:35:54 devstack sudo[112387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:55 devstack sudo[112387]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fef53f1a-343a-402c-aa2a-662003f39625" returned: 0 in 0.246s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-quobyte-fef53f1a-343a-402c-aa2a-662003f39625" released by "delete_volume" :: held 0.714s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Created reservations ['f44d6aea-d260-42c6-8d2b-96f8c665380a', '975ae7e4-3e58-4247-b2a9-b46c5e6cd29b', 'bcea4f34-ec68-4f74-bec8-73527b48d58f', 'daee0a15-dea5-43a5-88fd-5d93c075c949'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:55 devstack sudo[112390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:35:55 devstack sudo[112390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "cinder-d5a398a0-1d57-43dd-b367-fa1f1203057a-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-d5a398a0-1d57-43dd-b367-fa1f1203057a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:55 devstack sudo[112390]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.266s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:35:55 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Deleted volume successfully.
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "cinder-quobyte-d5a398a0-1d57-43dd-b367-fa1f1203057a" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-967bb719-57d8-4685-a26d-d9123edfe73f tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-fef53f1a-343a-402c-aa2a-662003f39625-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-quobyte-d5a398a0-1d57-43dd-b367-fa1f1203057a" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[8625793c-caf9-4635-9cc4-bf1221bc8f4a]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d5a398a0-1d57-43dd-b367-fa1f1203057a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:55 devstack sudo[112393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d5a398a0-1d57-43dd-b367-fa1f1203057a
Aug 12 16:35:55 devstack sudo[112393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:55 devstack sudo[112393]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d5a398a0-1d57-43dd-b367-fa1f1203057a" returned: 0 in 0.381s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d5a398a0-1d57-43dd-b367-fa1f1203057a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:56 devstack sudo[112398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d5a398a0-1d57-43dd-b367-fa1f1203057a
Aug 12 16:35:56 devstack sudo[112398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:56 devstack sudo[112398]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d5a398a0-1d57-43dd-b367-fa1f1203057a" returned: 0 in 0.243s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:56 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-quobyte-d5a398a0-1d57-43dd-b367-fa1f1203057a" released by "delete_volume" :: held 0.668s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:56 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Created reservations ['ab018a26-6dd4-4a37-b346-456531b4e388', '780fce0d-bec7-4e0d-a578-868014fcddf1', 'de592ec0-81a1-42d3-895f-6300f1a105ae', '5a4ebb1d-4dca-4579-ae0f-c44011888f89'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:35:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:35:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:35:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:56 devstack sudo[112401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:35:56 devstack sudo[112401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:56 devstack sudo[112401]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.271s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:56 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:35:56 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Deleted volume successfully.
Aug 12 16:35:56 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "cinder-5e87c4a2-8719-425d-b526-94bbd1120274-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:56 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ec6a5f16-18b3-4f9b-bb7a-43772c05f77d tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-d5a398a0-1d57-43dd-b367-fa1f1203057a-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:56 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-5e87c4a2-8719-425d-b526-94bbd1120274-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:56 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "cinder-quobyte-5e87c4a2-8719-425d-b526-94bbd1120274" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:56 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-quobyte-5e87c4a2-8719-425d-b526-94bbd1120274" acquired by "delete_volume" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:56 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[4311524c-ccc8-4282-a958-d51cf815cabb]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e87c4a2-8719-425d-b526-94bbd1120274 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:56 devstack sudo[112404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e87c4a2-8719-425d-b526-94bbd1120274
Aug 12 16:35:56 devstack sudo[112404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:57 devstack sudo[112404]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e87c4a2-8719-425d-b526-94bbd1120274" returned: 0 in 0.369s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e87c4a2-8719-425d-b526-94bbd1120274 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:57 devstack sudo[112409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e87c4a2-8719-425d-b526-94bbd1120274
Aug 12 16:35:57 devstack sudo[112409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:57 devstack sudo[112409]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5e87c4a2-8719-425d-b526-94bbd1120274" returned: 0 in 0.283s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-quobyte-5e87c4a2-8719-425d-b526-94bbd1120274" released by "delete_volume" :: held 0.696s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Created reservations ['10b79bf7-1612-46eb-bc5a-f6885e8039ee', '19b7333c-bbfa-4f54-85f4-1849f13a86fb', 'fe25cf80-a7c4-452a-9bb7-9726156c97c2', 'a63732aa-86d4-4c0e-bbb4-d134fcf30822'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:57 devstack sudo[112412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:35:57 devstack sudo[112412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:57 devstack sudo[112412]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.258s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:35:57 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Deleted volume successfully.
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "cinder-cef5027c-00ce-47b7-8621-2d0549330204-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-03eed94f-281e-498b-acac-019d4dc457f1 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-5e87c4a2-8719-425d-b526-94bbd1120274-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-cef5027c-00ce-47b7-8621-2d0549330204-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "cinder-quobyte-cef5027c-00ce-47b7-8621-2d0549330204" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-quobyte-cef5027c-00ce-47b7-8621-2d0549330204" acquired by "delete_volume" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[08da022b-0d56-43a5-a9b1-dece68fb919f]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cef5027c-00ce-47b7-8621-2d0549330204 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:58 devstack sudo[112415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cef5027c-00ce-47b7-8621-2d0549330204
Aug 12 16:35:58 devstack sudo[112415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:58 devstack sudo[112415]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cef5027c-00ce-47b7-8621-2d0549330204" returned: 0 in 0.378s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cef5027c-00ce-47b7-8621-2d0549330204 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:58 devstack sudo[112420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cef5027c-00ce-47b7-8621-2d0549330204
Aug 12 16:35:58 devstack sudo[112420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:58 devstack sudo[112420]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cef5027c-00ce-47b7-8621-2d0549330204" returned: 0 in 0.313s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:58 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-quobyte-cef5027c-00ce-47b7-8621-2d0549330204" released by "delete_volume" :: held 0.735s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:58 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Created reservations ['438bf046-2341-404b-908e-ec5ef9e77442', '0337de78-4ecc-4a3e-9c71-852390806ec2', '5bfa8740-17d5-4460-8ca3-157621cf1011', '875fbe12-2523-48ef-bee7-c85f45f4fe49'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:35:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:35:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:35:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:35:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:35:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:35:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:58 devstack sudo[112423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:35:58 devstack sudo[112423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:59 devstack sudo[112423]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "cinder-335aa57d-5ddb-4f9c-96d6-941c61a095dc-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.267s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:59 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:35:59 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Deleted volume successfully.
Aug 12 16:35:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-335aa57d-5ddb-4f9c-96d6-941c61a095dc-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5678c2ab-93dc-4015-91da-af6e160ce8f8 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-cef5027c-00ce-47b7-8621-2d0549330204-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:35:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "cinder-quobyte-335aa57d-5ddb-4f9c-96d6-941c61a095dc" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:35:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-quobyte-335aa57d-5ddb-4f9c-96d6-941c61a095dc" acquired by "delete_volume" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:35:59 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7a3faa-f8d9-4541-b164-dfdaa2f9f4fa]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:35:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-335aa57d-5ddb-4f9c-96d6-941c61a095dc {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:59 devstack sudo[112426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-335aa57d-5ddb-4f9c-96d6-941c61a095dc
Aug 12 16:35:59 devstack sudo[112426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:59 devstack sudo[112426]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-335aa57d-5ddb-4f9c-96d6-941c61a095dc" returned: 0 in 0.429s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-335aa57d-5ddb-4f9c-96d6-941c61a095dc {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:35:59 devstack sudo[112431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-335aa57d-5ddb-4f9c-96d6-941c61a095dc
Aug 12 16:35:59 devstack sudo[112431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:35:59 devstack sudo[112431]: pam_unix(sudo:session): session closed for user root
Aug 12 16:35:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-335aa57d-5ddb-4f9c-96d6-941c61a095dc" returned: 0 in 0.281s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:35:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-quobyte-335aa57d-5ddb-4f9c-96d6-941c61a095dc" released by "delete_volume" :: held 0.758s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:36:00 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Created reservations ['7c97d598-b69e-410f-ab6a-0d645c250eb4', '5750e9eb-3179-4688-baff-8a099f94de55', '23d7e59f-957e-47b9-8641-108cf7660ccb', '901887e8-39a1-4601-8b39-020be73b9234'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:36:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:36:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:36:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:36:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:36:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:36:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:00 devstack sudo[112434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:36:00 devstack sudo[112434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:00 devstack sudo[112434]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.389s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:00 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:36:00 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Deleted volume successfully.
Aug 12 16:36:00 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c6ff3f62-d4cc-45d1-abf6-46dbf926c975 tempest-CreateVolumesFromSourceVolumeTest-469617321 None] Lock "cinder-335aa57d-5ddb-4f9c-96d6-941c61a095dc-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:36:10 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=71,cinder:UPDATE=110,cinder:INSERT=24,cinder:DELETE=5 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:36:10 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=82,cinder:UPDATE=100,cinder:DELETE=13,cinder:INSERT=28 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:36:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:36:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:36:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:36:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:36:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:36:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:36:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:19 devstack sudo[112445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:36:19 devstack sudo[112445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:19 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:36:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Flow 'volume_create_manager' (7bfea406-d68b-48d1-a4bb-2cb1aba73c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:36:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f66330-ba8c-4041-9c22-e7190ff98a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:19 devstack sudo[112445]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3f66330-ba8c-4041-9c22-e7190ff98a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-112211550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=643b3002-babb-4dbb-bb5a-1b4c5236437d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c826a108a914fd9bb66c8da31052c82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:36:20Z,use_quota=True,user_id='1da6e07b593a46f2bd01f70d241b2871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ddced1-1b01-4f32-9bf1-660a2db261d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ddced1-1b01-4f32-9bf1-660a2db261d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf44797-95e7-4384-8731-b7ba2f8b0cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cf44797-95e7-4384-8731-b7ba2f8b0cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '643b3002-babb-4dbb-bb5a-1b4c5236437d', 'volume_name': 'volume-643b3002-babb-4dbb-bb5a-1b4c5236437d', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c9b8a6-01ae-4ee5-aaa4-4f0e4240c8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92c9b8a6-01ae-4ee5-aaa4-4f0e4240c8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172e3e62-5abb-4538-8340-81eed1b00e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:20 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Volume 643b3002-babb-4dbb-bb5a-1b4c5236437d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-643b3002-babb-4dbb-bb5a-1b4c5236437d', 'volume_size': 1}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:36:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-112211550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=643b3002-babb-4dbb-bb5a-1b4c5236437d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c826a108a914fd9bb66c8da31052c82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:36:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:36:20Z,use_quota=True,user_id='1da6e07b593a46f2bd01f70d241b2871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Creating volume 643b3002-babb-4dbb-bb5a-1b4c5236437d {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:36:20 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-643b3002-babb-4dbb-bb5a-1b4c5236437d 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.609s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 29 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>, <Thread(Rabbit-heartbeat, started daemon 134532925736384)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:36:20 devstack sudo[112448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-643b3002-babb-4dbb-bb5a-1b4c5236437d 1073741824
Aug 12 16:36:20 devstack sudo[112448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:20 devstack sudo[112448]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-643b3002-babb-4dbb-bb5a-1b4c5236437d 1073741824" returned: 0 in 0.565s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-643b3002-babb-4dbb-bb5a-1b4c5236437d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:20 devstack sudo[112469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-643b3002-babb-4dbb-bb5a-1b4c5236437d
Aug 12 16:36:20 devstack sudo[112469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:20 devstack sudo[112469]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-643b3002-babb-4dbb-bb5a-1b4c5236437d" returned: 0 in 0.309s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (172e3e62-5abb-4538-8340-81eed1b00e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-643b3002-babb-4dbb-bb5a-1b4c5236437d', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499ed77d-8668-4794-8ae6-0f4f708c7115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:21 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Volume volume-643b3002-babb-4dbb-bb5a-1b4c5236437d (643b3002-babb-4dbb-bb5a-1b4c5236437d): created successfully
Aug 12 16:36:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (499ed77d-8668-4794-8ae6-0f4f708c7115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Flow 'volume_create_manager' (7bfea406-d68b-48d1-a4bb-2cb1aba73c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:36:21 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e2c9fac9-0df4-4e78-aa18-a4e3629d895b tempest-ProjectReaderTests-279728795 None] Created volume successfully.
Aug 12 16:36:22 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] Acquiring lock "cinder-643b3002-babb-4dbb-bb5a-1b4c5236437d-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:36:22 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] Lock "cinder-643b3002-babb-4dbb-bb5a-1b4c5236437d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:36:22 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] Acquiring lock "cinder-quobyte-643b3002-babb-4dbb-bb5a-1b4c5236437d" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:36:22 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] Lock "cinder-quobyte-643b3002-babb-4dbb-bb5a-1b4c5236437d" acquired by "delete_volume" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:36:22 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b04e09-8969-4cde-beca-04680d5fd9c2]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:36:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-643b3002-babb-4dbb-bb5a-1b4c5236437d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:22 devstack sudo[112534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-643b3002-babb-4dbb-bb5a-1b4c5236437d
Aug 12 16:36:22 devstack sudo[112534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:23 devstack sudo[112534]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-643b3002-babb-4dbb-bb5a-1b4c5236437d" returned: 0 in 0.445s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-643b3002-babb-4dbb-bb5a-1b4c5236437d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:23 devstack sudo[112559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-643b3002-babb-4dbb-bb5a-1b4c5236437d
Aug 12 16:36:23 devstack sudo[112559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:23 devstack sudo[112559]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-643b3002-babb-4dbb-bb5a-1b4c5236437d" returned: 0 in 0.263s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] Lock "cinder-quobyte-643b3002-babb-4dbb-bb5a-1b4c5236437d" released by "delete_volume" :: held 0.776s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:36:23 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] Created reservations ['d8bf2028-74f3-4cc9-bf63-cfc633e8a734', '69796899-2044-47cc-bc05-9f94a85051e3', '1f9c1fcb-ff22-4b70-b321-a5201b626132', 'd1b30d2d-af58-44e2-94f3-e6e48060dd8b'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:36:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:36:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:36:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:36:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:36:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:36:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:23 devstack sudo[112578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:36:23 devstack sudo[112578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:23 devstack sudo[112578]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.287s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:23 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:36:23 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] Deleted volume successfully.
Aug 12 16:36:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-562ea6fd-c1bf-466e-9736-26c3cbf100d7 tempest-ProjectReaderTests-279728795 None] Lock "cinder-643b3002-babb-4dbb-bb5a-1b4c5236437d-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Flow 'volume_create_manager' (5da5e4c2-a76c-436c-9744-3efab4e10ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001fd501-21c6-4cd7-991b-7752beaabe1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (001fd501-21c6-4cd7-991b-7752beaabe1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1210702955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb22938c-cbe9-4a7b-ab21-60f49d609d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c826a108a914fd9bb66c8da31052c82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:36:24Z,use_quota=True,user_id='1da6e07b593a46f2bd01f70d241b2871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7642a28b-9cd0-47c4-ab15-aa8a19be7afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7642a28b-9cd0-47c4-ab15-aa8a19be7afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1be6a6a-ed6e-4afc-9e53-645b8a44c5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1be6a6a-ed6e-4afc-9e53-645b8a44c5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb22938c-cbe9-4a7b-ab21-60f49d609d07', 'volume_name': 'volume-bb22938c-cbe9-4a7b-ab21-60f49d609d07', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cefcc729-5d53-427c-afb0-1ca6e2557ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cefcc729-5d53-427c-afb0-1ca6e2557ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431a0a2a-4913-4d49-aada-4658cb459932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:24 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Volume bb22938c-cbe9-4a7b-ab21-60f49d609d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb22938c-cbe9-4a7b-ab21-60f49d609d07', 'volume_size': 1}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1210702955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb22938c-cbe9-4a7b-ab21-60f49d609d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c826a108a914fd9bb66c8da31052c82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:36:24Z,use_quota=True,user_id='1da6e07b593a46f2bd01f70d241b2871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Creating volume bb22938c-cbe9-4a7b-ab21-60f49d609d07 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:36:24 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb22938c-cbe9-4a7b-ab21-60f49d609d07 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:24 devstack sudo[112581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb22938c-cbe9-4a7b-ab21-60f49d609d07 1073741824
Aug 12 16:36:24 devstack sudo[112581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:24 devstack sudo[112581]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb22938c-cbe9-4a7b-ab21-60f49d609d07 1073741824" returned: 0 in 0.506s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb22938c-cbe9-4a7b-ab21-60f49d609d07 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:24 devstack sudo[112589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb22938c-cbe9-4a7b-ab21-60f49d609d07
Aug 12 16:36:24 devstack sudo[112589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:25 devstack sudo[112589]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb22938c-cbe9-4a7b-ab21-60f49d609d07" returned: 0 in 0.279s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:36:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:36:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431a0a2a-4913-4d49-aada-4658cb459932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb22938c-cbe9-4a7b-ab21-60f49d609d07', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b043c992-a141-43bd-bca6-a44a37b45737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:25 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Volume volume-bb22938c-cbe9-4a7b-ab21-60f49d609d07 (bb22938c-cbe9-4a7b-ab21-60f49d609d07): created successfully
Aug 12 16:36:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b043c992-a141-43bd-bca6-a44a37b45737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Flow 'volume_create_manager' (5da5e4c2-a76c-436c-9744-3efab4e10ef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:36:25 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-4a8d2645-605d-42d6-95e8-edcd7abee861 tempest-ProjectReaderTests-279728795 None] Created volume successfully.
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] Acquiring lock "cinder-bb22938c-cbe9-4a7b-ab21-60f49d609d07-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] Lock "cinder-bb22938c-cbe9-4a7b-ab21-60f49d609d07-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Flow 'volume_create_manager' (370d14ae-f9a6-4499-a149-542bcdd5856b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9ae4c6-064a-49c3-ac82-36117ff3a170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] Acquiring lock "cinder-quobyte-bb22938c-cbe9-4a7b-ab21-60f49d609d07" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9ae4c6-064a-49c3-ac82-36117ff3a170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-363229759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9fc47e1d72f431faa39f32a8650ef1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:36:26Z,use_quota=True,user_id='57e83daa88114cbc949e85f14cd732d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac43e92b-1b45-4e12-a566-79ff067d82f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac43e92b-1b45-4e12-a566-79ff067d82f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d73d33-12ef-46b5-83af-9c21b3661e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d73d33-12ef-46b5-83af-9c21b3661e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6', 'volume_name': 'volume-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2ae3cf-9167-4063-8164-d948d0511729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b2ae3cf-9167-4063-8164-d948d0511729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9423083-a94c-48f7-abb5-3ed2523a5b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:26 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Volume f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6', 'volume_size': 1}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-363229759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9fc47e1d72f431faa39f32a8650ef1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:36:26Z,use_quota=True,user_id='57e83daa88114cbc949e85f14cd732d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Creating volume f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:36:26 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] Lock "cinder-quobyte-bb22938c-cbe9-4a7b-ab21-60f49d609d07" acquired by "delete_volume" :: waited 0.097s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:36:26 devstack sudo[112592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6 1073741824
Aug 12 16:36:26 devstack sudo[112592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d4da04-51a1-42c8-85ef-6b48e3b397e0]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:36:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb22938c-cbe9-4a7b-ab21-60f49d609d07 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:26 devstack sudo[112594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb22938c-cbe9-4a7b-ab21-60f49d609d07
Aug 12 16:36:26 devstack sudo[112594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:27 devstack sudo[112594]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb22938c-cbe9-4a7b-ab21-60f49d609d07" returned: 0 in 0.390s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb22938c-cbe9-4a7b-ab21-60f49d609d07 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:27 devstack sudo[112592]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6 1073741824" returned: 0 in 0.472s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:27 devstack sudo[112602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb22938c-cbe9-4a7b-ab21-60f49d609d07
Aug 12 16:36:27 devstack sudo[112602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:27 devstack sudo[112604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6
Aug 12 16:36:27 devstack sudo[112604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:27 devstack sudo[112602]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bb22938c-cbe9-4a7b-ab21-60f49d609d07" returned: 0 in 0.282s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] Lock "cinder-quobyte-bb22938c-cbe9-4a7b-ab21-60f49d609d07" released by "delete_volume" :: held 0.755s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] Created reservations ['2dc3a034-749f-480e-a4aa-57be86dded8e', 'd92eae3e-1b2b-4881-a367-a73a764a3c44', 'a69a524a-572a-4c4e-ac51-c6146f955b69', 'fe9e1155-c8ec-43f2-9490-e29f466d3e2a'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:36:27 devstack sudo[112604]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6" returned: 0 in 0.326s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9423083-a94c-48f7-abb5-3ed2523a5b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712adb6f-26d9-41f4-8231-11e2c9e7f773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:27 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Volume volume-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6 (f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6): created successfully
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712adb6f-26d9-41f4-8231-11e2c9e7f773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Flow 'volume_create_manager' (370d14ae-f9a6-4499-a149-542bcdd5856b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:36:27 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a09488ff-6803-4105-bcf3-e0d109cd75c0 tempest-TestMinimumBasicScenario-489518099 None] Created volume successfully.
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:27 devstack sudo[112608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:36:27 devstack sudo[112608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:27 devstack sudo[112608]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.268s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:36:27 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] Deleted volume successfully.
Aug 12 16:36:27 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5c660a6c-43ad-4a91-840b-56a76433062d tempest-ProjectReaderTests-279728795 None] Lock "cinder-bb22938c-cbe9-4a7b-ab21-60f49d609d07-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Flow 'volume_create_manager' (93636887-95bb-4db4-bc0e-762a9baaf82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded150d0-688f-4c49-8d85-8eb94b9e492b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ded150d0-688f-4c49-8d85-8eb94b9e492b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1510914433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c826a108a914fd9bb66c8da31052c82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:36:28Z,use_quota=True,user_id='1da6e07b593a46f2bd01f70d241b2871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0134609c-a2ed-4c19-9af8-68e6da8c76b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0134609c-a2ed-4c19-9af8-68e6da8c76b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2781febc-db24-4f72-a9fd-91c871aab2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2781febc-db24-4f72-a9fd-91c871aab2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc', 'volume_name': 'volume-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b91ff8-7eec-4ea2-850d-6ae31f5eee65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b91ff8-7eec-4ea2-850d-6ae31f5eee65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d710dd-dd4a-480b-a8ea-f099b1eef6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:28 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Volume cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc', 'volume_size': 1}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1510914433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c826a108a914fd9bb66c8da31052c82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:36:28Z,use_quota=True,user_id='1da6e07b593a46f2bd01f70d241b2871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Creating volume cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:36:28 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:28 devstack sudo[112611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc 1073741824
Aug 12 16:36:28 devstack sudo[112611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:28 devstack sudo[112611]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc 1073741824" returned: 0 in 0.487s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:28 devstack sudo[112617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc
Aug 12 16:36:28 devstack sudo[112617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:28 devstack sudo[112617]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc" returned: 0 in 0.268s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46d710dd-dd4a-480b-a8ea-f099b1eef6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:28 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a908ee-0426-47ec-a3ec-c074403656e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:29 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Volume volume-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc (cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc): created successfully
Aug 12 16:36:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a908ee-0426-47ec-a3ec-c074403656e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Flow 'volume_create_manager' (93636887-95bb-4db4-bc0e-762a9baaf82d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:36:29 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-95d7a490-c6b9-4a31-8a5c-30435244f97a tempest-ProjectReaderTests-279728795 None] Created volume successfully.
Aug 12 16:36:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-ef101b38-1e49-42ed-a5bd-81d22cad114c req-d4cdddb7-31f6-4663-8e61-1274f32ac10a tempest-TestMinimumBasicScenario-489518099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:36:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-ef101b38-1e49-42ed-a5bd-81d22cad114c req-d4cdddb7-31f6-4663-8e61-1274f32ac10a tempest-TestMinimumBasicScenario-489518099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:36:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [req-ef101b38-1e49-42ed-a5bd-81d22cad114c req-d4cdddb7-31f6-4663-8e61-1274f32ac10a tempest-TestMinimumBasicScenario-489518099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:36:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-ef101b38-1e49-42ed-a5bd-81d22cad114c req-d4cdddb7-31f6-4663-8e61-1274f32ac10a tempest-TestMinimumBasicScenario-489518099 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96', 'name': 'volume-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '526fabcf-257a-471b-b661-4db07e4804cf', 'enforce_multipath': True} {{(pid=94457) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Aug 12 16:36:29 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-ef101b38-1e49-42ed-a5bd-81d22cad114c req-d4cdddb7-31f6-4663-8e61-1274f32ac10a tempest-TestMinimumBasicScenario-489518099 None] attachment_update completed successfully.
Aug 12 16:36:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] Acquiring lock "cinder-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:36:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] Lock "cinder-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:36:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] Acquiring lock "cinder-quobyte-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:36:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] Lock "cinder-quobyte-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc" acquired by "delete_volume" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:36:30 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[85803499-d17e-4c39-80ae-80f87a1539a7]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:36:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:30 devstack sudo[113054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc
Aug 12 16:36:30 devstack sudo[113054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:30 devstack sudo[113054]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc" returned: 0 in 0.391s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:30 devstack sudo[113059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc
Aug 12 16:36:30 devstack sudo[113059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:31 devstack sudo[113059]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc" returned: 0 in 0.244s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] Lock "cinder-quobyte-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc" released by "delete_volume" :: held 0.701s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:36:31 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] Created reservations ['373b6c09-b6a2-4383-b886-6aa0bfe44863', 'd10db957-203e-48e7-82b1-84d507664a17', 'e5feca73-ede0-4666-bb1c-6111d72c32d1', '391ac8ef-f06a-4217-a2e5-f19d296e95e6'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:36:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:36:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:36:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:36:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:36:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:36:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:31 devstack sudo[113062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:36:31 devstack sudo[113062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:31 devstack sudo[113062]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.318s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:31 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:36:31 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] Deleted volume successfully.
Aug 12 16:36:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a036805e-e0ff-4cb2-bdd3-07e313ae8f65 tempest-ProjectReaderTests-279728795 None] Lock "cinder-cd226d6c-e9d4-48dc-aa0d-bcea4de4b7bc-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Flow 'volume_create_manager' (02b66cce-c13b-4191-a12e-29225a5ed768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d645e3e-679d-48b3-a450-664e93a67f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d645e3e-679d-48b3-a450-664e93a67f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-341317344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e795982c-3a17-4318-97a4-14f9758748cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c826a108a914fd9bb66c8da31052c82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:36:32Z,use_quota=True,user_id='1da6e07b593a46f2bd01f70d241b2871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ad14b5-0dc9-4d4f-844a-e9dcf7b2b234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ad14b5-0dc9-4d4f-844a-e9dcf7b2b234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11cddbe1-b223-4459-a096-fe15c61e7e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11cddbe1-b223-4459-a096-fe15c61e7e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e795982c-3a17-4318-97a4-14f9758748cf', 'volume_name': 'volume-e795982c-3a17-4318-97a4-14f9758748cf', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db345ef0-2370-4b40-9489-557e223ae962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db345ef0-2370-4b40-9489-557e223ae962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655a08f6-a6ea-4622-a3ea-c5b03b85b98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:32 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Volume e795982c-3a17-4318-97a4-14f9758748cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e795982c-3a17-4318-97a4-14f9758748cf', 'volume_size': 1}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:36:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-341317344',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e795982c-3a17-4318-97a4-14f9758748cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c826a108a914fd9bb66c8da31052c82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:36:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:36:32Z,use_quota=True,user_id='1da6e07b593a46f2bd01f70d241b2871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Creating volume e795982c-3a17-4318-97a4-14f9758748cf {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:36:32 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e795982c-3a17-4318-97a4-14f9758748cf 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:32 devstack sudo[113065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e795982c-3a17-4318-97a4-14f9758748cf 1073741824
Aug 12 16:36:32 devstack sudo[113065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:32 devstack sudo[113065]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e795982c-3a17-4318-97a4-14f9758748cf 1073741824" returned: 0 in 0.491s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e795982c-3a17-4318-97a4-14f9758748cf {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:32 devstack sudo[113071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e795982c-3a17-4318-97a4-14f9758748cf
Aug 12 16:36:32 devstack sudo[113071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:33 devstack sudo[113071]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e795982c-3a17-4318-97a4-14f9758748cf" returned: 0 in 0.293s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:36:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:36:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (655a08f6-a6ea-4622-a3ea-c5b03b85b98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e795982c-3a17-4318-97a4-14f9758748cf', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4562b4-009e-467c-8726-5d94028e3681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:33 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Volume volume-e795982c-3a17-4318-97a4-14f9758748cf (e795982c-3a17-4318-97a4-14f9758748cf): created successfully
Aug 12 16:36:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d4562b4-009e-467c-8726-5d94028e3681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Flow 'volume_create_manager' (02b66cce-c13b-4191-a12e-29225a5ed768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:36:33 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-46d365ec-868c-4adb-87f9-541bcd13c62b tempest-ProjectReaderTests-279728795 None] Created volume successfully.
Aug 12 16:36:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] Acquiring lock "cinder-e795982c-3a17-4318-97a4-14f9758748cf-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:36:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] Lock "cinder-e795982c-3a17-4318-97a4-14f9758748cf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:36:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] Acquiring lock "cinder-quobyte-e795982c-3a17-4318-97a4-14f9758748cf" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:36:34 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] Lock "cinder-quobyte-e795982c-3a17-4318-97a4-14f9758748cf" acquired by "delete_volume" :: waited 0.019s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:36:34 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8bb8cb-2bfb-4f90-ad8e-b89e547aa97a]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:36:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e795982c-3a17-4318-97a4-14f9758748cf {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:34 devstack sudo[113082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e795982c-3a17-4318-97a4-14f9758748cf
Aug 12 16:36:34 devstack sudo[113082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:34 devstack sudo[113082]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e795982c-3a17-4318-97a4-14f9758748cf" returned: 0 in 0.542s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e795982c-3a17-4318-97a4-14f9758748cf {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:34 devstack sudo[113087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e795982c-3a17-4318-97a4-14f9758748cf
Aug 12 16:36:34 devstack sudo[113087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:35 devstack sudo[113087]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e795982c-3a17-4318-97a4-14f9758748cf" returned: 0 in 0.373s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] Lock "cinder-quobyte-e795982c-3a17-4318-97a4-14f9758748cf" released by "delete_volume" :: held 0.985s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:36:35 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] Created reservations ['cdae6757-0c4e-4b54-9e1b-5d0fb21542ed', '249a6777-fab3-455d-8d9d-f22fd2c0f2ad', 'd28b1dbd-de4e-4cf0-aa61-afb40fa9d076', '1f971c13-2f8f-41bd-973c-ba497b0df22f'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:36:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:36:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:36:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:36:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:36:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:36:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:35 devstack sudo[113090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:36:35 devstack sudo[113090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:35 devstack sudo[113090]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.296s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:35 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:36:35 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] Deleted volume successfully.
Aug 12 16:36:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3d8b2b49-f9e1-469c-9d2e-4b66f25f3b76 tempest-ProjectReaderTests-279728795 None] Lock "cinder-e795982c-3a17-4318-97a4-14f9758748cf-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:36:45 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=40,cinder:UPDATE=53,cinder:INSERT=8,cinder:DELETE=3 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:36:45 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=33,cinder:UPDATE=44,cinder:DELETE=6,cinder:INSERT=13 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:36:58 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=1 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:36:58 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:UPDATE=1 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Flow 'volume_create_manager' (1f515c87-c4ed-4a75-9b39-8c349c545015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b14ccaf-31a0-4e31-bcbe-9c4b41a67d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b14ccaf-31a0-4e31-bcbe-9c4b41a67d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-16788485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92c3473-76f1-4ece-a7cf-0c82e09e5405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68675ce75dff429cb0b0d4a0546731c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:36:59Z,use_quota=True,user_id='0facdbdf32eb40ca812e69cfcb55f7e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378fb0b9-6ed9-4336-8524-63028daf43c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (378fb0b9-6ed9-4336-8524-63028daf43c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aba91a7-deef-41f5-bc49-ec6b485c60fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aba91a7-deef-41f5-bc49-ec6b485c60fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e92c3473-76f1-4ece-a7cf-0c82e09e5405', 'volume_name': 'volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656f9349-7f54-4ed6-8a20-58128149656b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (656f9349-7f54-4ed6-8a20-58128149656b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ecff9eb-dcbe-4007-86da-67e22dfead4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:36:59 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Volume e92c3473-76f1-4ece-a7cf-0c82e09e5405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405', 'volume_size': 1}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-16788485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e92c3473-76f1-4ece-a7cf-0c82e09e5405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68675ce75dff429cb0b0d4a0546731c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:36:59Z,use_quota=True,user_id='0facdbdf32eb40ca812e69cfcb55f7e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Creating volume e92c3473-76f1-4ece-a7cf-0c82e09e5405 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:36:59 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:59 devstack sudo[113203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405 1073741824
Aug 12 16:36:59 devstack sudo[113203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:36:59 devstack sudo[113203]: pam_unix(sudo:session): session closed for user root
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405 1073741824" returned: 0 in 0.447s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:36:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:36:59 devstack sudo[113208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405
Aug 12 16:36:59 devstack sudo[113208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:00 devstack sudo[113208]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405" returned: 0 in 0.257s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:37:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ecff9eb-dcbe-4007-86da-67e22dfead4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823bbe94-51a8-429d-881b-031bf1942c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:00 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Volume volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405 (e92c3473-76f1-4ece-a7cf-0c82e09e5405): created successfully
Aug 12 16:37:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823bbe94-51a8-429d-881b-031bf1942c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Flow 'volume_create_manager' (1f515c87-c4ed-4a75-9b39-8c349c545015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:37:00 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-f21e5483-a8b2-4bb6-9dc4-1dee7e7f3528 tempest-SnapshotDependencyTests-925597995 None] Created volume successfully.
Aug 12 16:37:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-21a708cf-eec3-40cc-8ac2-7f2ea7d01c47 tempest-SnapshotDependencyTests-925597995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-21a708cf-eec3-40cc-8ac2-7f2ea7d01c47 tempest-SnapshotDependencyTests-925597995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-21a708cf-eec3-40cc-8ac2-7f2ea7d01c47 tempest-SnapshotDependencyTests-925597995 None] Creating offline snapshot dae9c337-6fba-4221-aa71-b0d2aa7fc24f of volume e92c3473-76f1-4ece-a7cf-0c82e09e5405 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:37:00 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[68110f94-9574-47f0-9921-f975d18b7b8e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:37:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21a708cf-eec3-40cc-8ac2-7f2ea7d01c47 tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:00 devstack sudo[113212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405
Aug 12 16:37:00 devstack sudo[113212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:00 devstack sudo[113212]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21a708cf-eec3-40cc-8ac2-7f2ea7d01c47 tempest-SnapshotDependencyTests-925597995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405" returned: 0 in 0.408s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21a708cf-eec3-40cc-8ac2-7f2ea7d01c47 tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:00 devstack sudo[113218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f 1G
Aug 12 16:37:00 devstack sudo[113218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:01 devstack sudo[113218]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21a708cf-eec3-40cc-8ac2-7f2ea7d01c47 tempest-SnapshotDependencyTests-925597995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f 1G" returned: 0 in 0.408s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21a708cf-eec3-40cc-8ac2-7f2ea7d01c47 tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:01 devstack sudo[113223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f
Aug 12 16:37:01 devstack sudo[113223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:01 devstack sudo[113223]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21a708cf-eec3-40cc-8ac2-7f2ea7d01c47 tempest-SnapshotDependencyTests-925597995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f" returned: 0 in 0.310s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:01 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-21a708cf-eec3-40cc-8ac2-7f2ea7d01c47 tempest-SnapshotDependencyTests-925597995 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f is being set with open permissions: ugo+rw
Aug 12 16:37:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21a708cf-eec3-40cc-8ac2-7f2ea7d01c47 tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:01 devstack sudo[113228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f
Aug 12 16:37:01 devstack sudo[113228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:01 devstack sudo[113228]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21a708cf-eec3-40cc-8ac2-7f2ea7d01c47 tempest-SnapshotDependencyTests-925597995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f" returned: 0 in 0.242s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21a708cf-eec3-40cc-8ac2-7f2ea7d01c47 tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:01 devstack sudo[113231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.info
Aug 12 16:37:01 devstack sudo[113231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:02 devstack sudo[113231]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21a708cf-eec3-40cc-8ac2-7f2ea7d01c47 tempest-SnapshotDependencyTests-925597995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.info" returned: 0 in 0.244s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:02 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-21a708cf-eec3-40cc-8ac2-7f2ea7d01c47 tempest-SnapshotDependencyTests-925597995 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.info is being set with open permissions: ugo+rw
Aug 12 16:37:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21a708cf-eec3-40cc-8ac2-7f2ea7d01c47 tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:02 devstack sudo[113234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.info
Aug 12 16:37:02 devstack sudo[113234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:02 devstack sudo[113234]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-21a708cf-eec3-40cc-8ac2-7f2ea7d01c47 tempest-SnapshotDependencyTests-925597995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.info" returned: 0 in 0.249s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-21a708cf-eec3-40cc-8ac2-7f2ea7d01c47 tempest-SnapshotDependencyTests-925597995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:02 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-21a708cf-eec3-40cc-8ac2-7f2ea7d01c47 tempest-SnapshotDependencyTests-925597995 None] Create snapshot completed successfully
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Flow 'volume_create_manager' (82a5a095-c508-4f5a-a516-15363ca9ff80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6dc6a9d-6b39-4af5-a9f2-860850064ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6dc6a9d-6b39-4af5-a9f2-860850064ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bd98b3e-f699-4fae-8d36-2035b86382f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68675ce75dff429cb0b0d4a0546731c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dae9c337-6fba-4221-aa71-b0d2aa7fc24f,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:37:03Z,use_quota=True,user_id='0facdbdf32eb40ca812e69cfcb55f7e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa5d54d-d3e9-49b4-a06c-6e990f5d0b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aa5d54d-d3e9-49b4-a06c-6e990f5d0b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd3601e-4155-438e-9b80-6f531d9838d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd3601e-4155-438e-9b80-6f531d9838d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2bd98b3e-f699-4fae-8d36-2035b86382f3', 'volume_name': 'volume-2bd98b3e-f699-4fae-8d36-2035b86382f3', 'volume_size': 1, 'snapshot_id': 'dae9c337-6fba-4221-aa71-b0d2aa7fc24f'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23952ee-7898-4c30-86e9-bd5915a77205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e23952ee-7898-4c30-86e9-bd5915a77205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfabfe86-6238-41de-a9e7-15a6f57df0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:03 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Volume 2bd98b3e-f699-4fae-8d36-2035b86382f3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2bd98b3e-f699-4fae-8d36-2035b86382f3', 'volume_size': 1, 'snapshot_id': 'dae9c337-6fba-4221-aa71-b0d2aa7fc24f'}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Acquiring lock "cinder-quobyte-dae9c337-6fba-4221-aa71-b0d2aa7fc24f-2bd98b3e-f699-4fae-8d36-2035b86382f3" by "_create_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Lock "cinder-quobyte-dae9c337-6fba-4221-aa71-b0d2aa7fc24f-2bd98b3e-f699-4fae-8d36-2035b86382f3" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Creating volume 2bd98b3e-f699-4fae-8d36-2035b86382f3 from snapshot dae9c337-6fba-4221-aa71-b0d2aa7fc24f {{(pid=94457) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Acquiring lock "cinder-quobyte-2bd98b3e-f699-4fae-8d36-2035b86382f3" by "_copy_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Lock "cinder-quobyte-2bd98b3e-f699-4fae-8d36-2035b86382f3" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] snapshot: dae9c337-6fba-4221-aa71-b0d2aa7fc24f, volume: 2bd98b3e-f699-4fae-8d36-2035b86382f3,  {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b8265f-d338-4215-abad-205752261fcb]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:03 devstack sudo[113245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f
Aug 12 16:37:03 devstack sudo[113245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:03 devstack sudo[113245]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f" returned: 0 in 0.373s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[32452adc-6c5b-4251-b294-d7d8acf2c2d7]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:37:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:04 devstack sudo[113250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405
Aug 12 16:37:04 devstack sudo[113250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:04 devstack sudo[113250]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405" returned: 0 in 0.378s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:04 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405 {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 12 16:37:04 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Creating direct copy from snapshot {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 12 16:37:04 devstack cinder-volume[94457]: DEBUG cinder.utils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Path /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2bd98b3e-f699-4fae-8d36-2035b86382f3 not found in is_blk_device check {{(pid=94457) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 12 16:37:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2bd98b3e-f699-4fae-8d36-2035b86382f3 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:04 devstack sudo[113255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2bd98b3e-f699-4fae-8d36-2035b86382f3
Aug 12 16:37:04 devstack sudo[113255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:08 devstack sudo[113255]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2bd98b3e-f699-4fae-8d36-2035b86382f3" returned: 0 in 4.213s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:08 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405, size 1024.00 MB, duration 4.21 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2bd98b3e-f699-4fae-8d36-2035b86382f3 {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:37:08 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Converted 1024.00 MB image at 243.00 MB/s
Aug 12 16:37:08 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2bd98b3e-f699-4fae-8d36-2035b86382f3 is being set with open permissions: ugo+rw
Aug 12 16:37:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2bd98b3e-f699-4fae-8d36-2035b86382f3 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:08 devstack sudo[113270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2bd98b3e-f699-4fae-8d36-2035b86382f3
Aug 12 16:37:08 devstack sudo[113270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:08 devstack sudo[113270]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2bd98b3e-f699-4fae-8d36-2035b86382f3" returned: 0 in 0.246s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:08 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Lock "cinder-quobyte-2bd98b3e-f699-4fae-8d36-2035b86382f3" released by "_copy_volume_from_snapshot" :: held 5.287s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:08 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Lock "cinder-quobyte-dae9c337-6fba-4221-aa71-b0d2aa7fc24f-2bd98b3e-f699-4fae-8d36-2035b86382f3" released by "_create_volume_from_snapshot" :: held 5.351s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.367s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfabfe86-6238-41de-a9e7-15a6f57df0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bd98b3e-f699-4fae-8d36-2035b86382f3', 'volume_size': 1, 'snapshot_id': 'dae9c337-6fba-4221-aa71-b0d2aa7fc24f'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c916a1d9-290e-4894-8f03-91e690274b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:08 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Volume volume-2bd98b3e-f699-4fae-8d36-2035b86382f3 (2bd98b3e-f699-4fae-8d36-2035b86382f3): created successfully
Aug 12 16:37:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c916a1d9-290e-4894-8f03-91e690274b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Flow 'volume_create_manager' (82a5a095-c508-4f5a-a516-15363ca9ff80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:37:08 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-8331195b-ec6a-45b6-8040-5ab1351e5439 tempest-SnapshotDependencyTests-925597995 None] Created volume successfully.
Aug 12 16:37:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] Acquiring lock "cinder-dae9c337-6fba-4221-aa71-b0d2aa7fc24f-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] Lock "cinder-dae9c337-6fba-4221-aa71-b0d2aa7fc24f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] Acquiring lock "cinder-quobyte-e92c3473-76f1-4ece-a7cf-0c82e09e5405" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] Lock "cinder-quobyte-e92c3473-76f1-4ece-a7cf-0c82e09e5405" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] Acquiring lock "cinder-quobyte-dae9c337-6fba-4221-aa71-b0d2aa7fc24f" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] Lock "cinder-quobyte-dae9c337-6fba-4221-aa71-b0d2aa7fc24f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] Deleting offline snapshot dae9c337-6fba-4221-aa71-b0d2aa7fc24f of volume e92c3473-76f1-4ece-a7cf-0c82e09e5405 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:37:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] snapshot_file for this snap is: volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:37:09 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdeaa13-0b46-4b91-a000-7758da5e38d4]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:37:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:10 devstack sudo[113273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f
Aug 12 16:37:10 devstack sudo[113273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:10 devstack sudo[113273]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f" returned: 0 in 0.348s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:37:10 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9e86de-9904-475d-86a7-b6f262f2462a]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:37:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:10 devstack sudo[113280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405
Aug 12 16:37:10 devstack sudo[113280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:10 devstack sudo[113280]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405" returned: 0 in 0.520s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:10 devstack sudo[113285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f
Aug 12 16:37:10 devstack sudo[113285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:11 devstack sudo[113285]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f" returned: 0 in 0.333s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:11 devstack sudo[113291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f
Aug 12 16:37:11 devstack sudo[113291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:11 devstack sudo[113291]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405.dae9c337-6fba-4221-aa71-b0d2aa7fc24f" returned: 0 in 0.246s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] Lock "cinder-quobyte-dae9c337-6fba-4221-aa71-b0d2aa7fc24f" released by "_delete_snapshot" :: held 1.541s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] Lock "cinder-quobyte-e92c3473-76f1-4ece-a7cf-0c82e09e5405" released by "delete_snapshot" :: held 1.563s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:11 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] Created reservations ['e87e6522-1c5b-4429-b7fc-b5228a9ff5c7', '8ea963c2-be64-4944-9e91-10d2a1401c65', '64463d26-df14-4ffe-a154-42b0243d2330', 'bfb00d49-b27a-4003-b0a1-3294ecf1da9d'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:37:11 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] Delete snapshot completed successfully.
Aug 12 16:37:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4f5ce5f9-5433-4172-84b5-944316197f08 tempest-SnapshotDependencyTests-925597995 None] Lock "cinder-dae9c337-6fba-4221-aa71-b0d2aa7fc24f-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] Acquiring lock "cinder-e92c3473-76f1-4ece-a7cf-0c82e09e5405-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] Lock "cinder-e92c3473-76f1-4ece-a7cf-0c82e09e5405-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] Acquiring lock "cinder-quobyte-e92c3473-76f1-4ece-a7cf-0c82e09e5405" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] Lock "cinder-quobyte-e92c3473-76f1-4ece-a7cf-0c82e09e5405" acquired by "delete_volume" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:12 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a7de03-099e-4fa6-9bc6-ce8b9d5877f2]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:37:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:12 devstack sudo[113294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405
Aug 12 16:37:12 devstack sudo[113294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:12 devstack sudo[113294]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405" returned: 0 in 0.368s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:12 devstack sudo[113299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405
Aug 12 16:37:12 devstack sudo[113299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:12 devstack sudo[113299]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e92c3473-76f1-4ece-a7cf-0c82e09e5405" returned: 0 in 0.259s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] Lock "cinder-quobyte-e92c3473-76f1-4ece-a7cf-0c82e09e5405" released by "delete_volume" :: held 0.690s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:12 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] Created reservations ['941541a0-ba14-4260-a2da-33cd856a1d2f', '54d450fb-ee72-4a66-9408-c0c8b9e12eed', '0a7ad82f-a4f3-4eae-a2d8-f01a1d6c3b74', 'a21e0e97-1f1b-43a4-ac49-b919b0d2619b'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:37:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:37:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:37:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:12 devstack sudo[113302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:37:12 devstack sudo[113302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:13 devstack sudo[113302]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.258s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:13 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:37:13 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] Deleted volume successfully.
Aug 12 16:37:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-372cf2b6-6358-4af0-b5cf-a6511d0b5cb4 tempest-SnapshotDependencyTests-925597995 None] Lock "cinder-e92c3473-76f1-4ece-a7cf-0c82e09e5405-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] Acquiring lock "cinder-2bd98b3e-f699-4fae-8d36-2035b86382f3-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] Lock "cinder-2bd98b3e-f699-4fae-8d36-2035b86382f3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] Acquiring lock "cinder-quobyte-2bd98b3e-f699-4fae-8d36-2035b86382f3" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] Lock "cinder-quobyte-2bd98b3e-f699-4fae-8d36-2035b86382f3" acquired by "delete_volume" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:13 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54b21ae-8396-416c-a108-51108a3a6ba6]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:37:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2bd98b3e-f699-4fae-8d36-2035b86382f3 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:13 devstack sudo[113305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2bd98b3e-f699-4fae-8d36-2035b86382f3
Aug 12 16:37:13 devstack sudo[113305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:13 devstack sudo[113305]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2bd98b3e-f699-4fae-8d36-2035b86382f3" returned: 0 in 0.365s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2bd98b3e-f699-4fae-8d36-2035b86382f3 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:13 devstack sudo[113314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2bd98b3e-f699-4fae-8d36-2035b86382f3
Aug 12 16:37:13 devstack sudo[113314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:13 devstack sudo[113314]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2bd98b3e-f699-4fae-8d36-2035b86382f3" returned: 0 in 0.247s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] Lock "cinder-quobyte-2bd98b3e-f699-4fae-8d36-2035b86382f3" released by "delete_volume" :: held 0.658s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:14 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] Created reservations ['2e93fe40-ba08-439c-8d05-15022d200227', 'aeebf866-53db-47cd-9fec-cd7c4dca0e1b', '4d4cb902-2da1-4525-93d0-7efd211efdb8', '0a2e5f86-be88-411e-8e97-cc4fc341cbc0'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:37:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:37:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:37:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:14 devstack sudo[113317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:37:14 devstack sudo[113317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:14 devstack sudo[113317]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.254s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:14 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:37:14 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] Deleted volume successfully.
Aug 12 16:37:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-def70236-2df4-4ff2-9975-8435bc19425b tempest-SnapshotDependencyTests-925597995 None] Lock "cinder-2bd98b3e-f699-4fae-8d36-2035b86382f3-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:16 devstack cinder-volume[94457]: INFO cinder.volume.manager [req-46bd061d-5689-406c-8750-1d68b12f7cf6 req-32ebfe65-b6c9-40f0-b293-a5142a4e15e2 tempest-TestMinimumBasicScenario-489518099 None] Terminate volume connection completed successfully.
Aug 12 16:37:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [req-46bd061d-5689-406c-8750-1d68b12f7cf6 req-32ebfe65-b6c9-40f0-b293-a5142a4e15e2 tempest-TestMinimumBasicScenario-489518099 None] Deleting attachment 526fabcf-257a-471b-b661-4db07e4804cf. {{(pid=94457) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Aug 12 16:37:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] Acquiring lock "cinder-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] Lock "cinder-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] Acquiring lock "cinder-quobyte-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] Lock "cinder-quobyte-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6" acquired by "delete_volume" :: waited 0.029s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:17 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[15216c7c-855e-4482-b2e0-77d7e462ba08]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:37:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:17 devstack sudo[113332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6
Aug 12 16:37:17 devstack sudo[113332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:17 devstack sudo[113332]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6" returned: 0 in 0.397s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:17 devstack sudo[113337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6
Aug 12 16:37:17 devstack sudo[113337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:18 devstack sudo[113337]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6" returned: 0 in 0.256s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] Lock "cinder-quobyte-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6" released by "delete_volume" :: held 0.698s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:18 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] Created reservations ['7f24e953-8731-4340-9499-306dc503c241', 'c6925ae8-02cd-40b1-87ab-5449675c9779', '447547da-b38e-4677-a11d-a242d4250deb', 'eeda6110-9d3d-41e4-8d44-b1998df5af56'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:37:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:37:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:37:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:18 devstack sudo[113340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:37:18 devstack sudo[113340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:18 devstack sudo[113340]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.404s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:18 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:37:18 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] Deleted volume successfully.
Aug 12 16:37:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b249e0f9-ace1-4b7a-99f7-08dc2d3b4955 tempest-TestMinimumBasicScenario-489518099 None] Lock "cinder-f9794ca2-f1f6-4c4d-81e1-4d7a15e5eac6-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:37:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:37:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:37:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:19 devstack sudo[113363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:37:19 devstack sudo[113363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:19 devstack sudo[113363]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.336s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:37:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:37:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 29 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:37:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>, <Thread(Rabbit-heartbeat, started daemon 134532925736384)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:37:28 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=30,cinder:UPDATE=37,cinder:INSERT=8,cinder:DELETE=1 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:37:28 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=31,cinder:UPDATE=37,cinder:INSERT=11,cinder:DELETE=5 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Flow 'volume_create_manager' (80e47514-235a-449a-a807-53cce13ad279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e88c30c-eb4f-4b56-9fa4-e5776521364a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e88c30c-eb4f-4b56-9fa4-e5776521364a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbe2c2a-6541-4d98-b72c-a01e132f8386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9584ed74a1fe4ec2b03bcd66a10f31f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:37:34Z,use_quota=True,user_id='082a7c73a9e4445ebbf1a919805802bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858b12ee-4b57-47a4-9081-d574a7e40cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858b12ee-4b57-47a4-9081-d574a7e40cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4420e05-1014-490c-881a-d06812f0dd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4420e05-1014-490c-881a-d06812f0dd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbbe2c2a-6541-4d98-b72c-a01e132f8386', 'volume_name': 'volume-dbbe2c2a-6541-4d98-b72c-a01e132f8386', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77612eb-80f6-46ac-b8b6-edc0f71937af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77612eb-80f6-46ac-b8b6-edc0f71937af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83041d3e-2c58-4d69-a3a6-2cf70cd6f8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:33 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Volume dbbe2c2a-6541-4d98-b72c-a01e132f8386: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbbe2c2a-6541-4d98-b72c-a01e132f8386', 'volume_size': 1}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbe2c2a-6541-4d98-b72c-a01e132f8386,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9584ed74a1fe4ec2b03bcd66a10f31f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:37:34Z,use_quota=True,user_id='082a7c73a9e4445ebbf1a919805802bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Creating volume dbbe2c2a-6541-4d98-b72c-a01e132f8386 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:37:33 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:37:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dbbe2c2a-6541-4d98-b72c-a01e132f8386 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:34 devstack sudo[113423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dbbe2c2a-6541-4d98-b72c-a01e132f8386 1073741824
Aug 12 16:37:34 devstack sudo[113423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:34 devstack sudo[113423]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dbbe2c2a-6541-4d98-b72c-a01e132f8386 1073741824" returned: 0 in 0.412s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dbbe2c2a-6541-4d98-b72c-a01e132f8386 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:34 devstack sudo[113429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dbbe2c2a-6541-4d98-b72c-a01e132f8386
Aug 12 16:37:34 devstack sudo[113429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:34 devstack sudo[113429]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dbbe2c2a-6541-4d98-b72c-a01e132f8386" returned: 0 in 0.245s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:37:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83041d3e-2c58-4d69-a3a6-2cf70cd6f8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbbe2c2a-6541-4d98-b72c-a01e132f8386', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a16a86-5c3d-4df9-ab65-52523fd90718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:34 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Volume volume-dbbe2c2a-6541-4d98-b72c-a01e132f8386 (dbbe2c2a-6541-4d98-b72c-a01e132f8386): created successfully
Aug 12 16:37:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a16a86-5c3d-4df9-ab65-52523fd90718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Flow 'volume_create_manager' (80e47514-235a-449a-a807-53cce13ad279) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:37:34 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ea19ac9a-6c47-4e04-88eb-1a04f2963935 tempest-CinderUnicodeTest-179905329 None] Created volume successfully.
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Flow 'volume_create_manager' (58610186-fbde-44c1-8f8f-90e052736553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4aa7d0-76a0-47b5-9b9c-a7f9baec3248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa4aa7d0-76a0-47b5-9b9c-a7f9baec3248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:37:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-500974088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73bf75a2-c7a0-46b8-84f1-e996b6135a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9584ed74a1fe4ec2b03bcd66a10f31f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:37:35Z,use_quota=True,user_id='082a7c73a9e4445ebbf1a919805802bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a12b76-275d-409f-8514-f4e4bd0f4500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28a12b76-275d-409f-8514-f4e4bd0f4500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c065e1f-29bb-49a2-8996-c10f5ce21587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c065e1f-29bb-49a2-8996-c10f5ce21587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73bf75a2-c7a0-46b8-84f1-e996b6135a66', 'volume_name': 'volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182edcdd-c3c6-4792-8e22-5ff0fd88a3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182edcdd-c3c6-4792-8e22-5ff0fd88a3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b741ee45-ada2-48b4-ae9a-3168070263b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:35 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Volume 73bf75a2-c7a0-46b8-84f1-e996b6135a66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66', 'volume_size': 1}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:37:35Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-500974088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73bf75a2-c7a0-46b8-84f1-e996b6135a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9584ed74a1fe4ec2b03bcd66a10f31f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:37:35Z,use_quota=True,user_id='082a7c73a9e4445ebbf1a919805802bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Creating volume 73bf75a2-c7a0-46b8-84f1-e996b6135a66 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:37:35 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:35 devstack sudo[113432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66 1073741824
Aug 12 16:37:35 devstack sudo[113432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:35 devstack sudo[113432]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66 1073741824" returned: 0 in 0.410s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:35 devstack sudo[113437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66
Aug 12 16:37:35 devstack sudo[113437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:36 devstack sudo[113437]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66" returned: 0 in 0.238s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:37:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b741ee45-ada2-48b4-ae9a-3168070263b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (942e386b-da4c-40d0-9654-eb1f1cf4ad5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:36 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Volume volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66 (73bf75a2-c7a0-46b8-84f1-e996b6135a66): created successfully
Aug 12 16:37:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (942e386b-da4c-40d0-9654-eb1f1cf4ad5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Flow 'volume_create_manager' (58610186-fbde-44c1-8f8f-90e052736553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:37:36 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-9f35f25b-4dc2-4092-9901-d31832b57a6c tempest-CinderUnicodeTest-179905329 None] Created volume successfully.
Aug 12 16:37:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2a4ff5b9-dcfc-4ef4-af8c-1dc72de8bfb5 tempest-CinderUnicodeTest-179905329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2a4ff5b9-dcfc-4ef4-af8c-1dc72de8bfb5 tempest-CinderUnicodeTest-179905329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-2a4ff5b9-dcfc-4ef4-af8c-1dc72de8bfb5 tempest-CinderUnicodeTest-179905329 None] Creating offline snapshot f7888da9-0860-4e8a-8da7-391bfff6d57e of volume 73bf75a2-c7a0-46b8-84f1-e996b6135a66 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:37:36 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2d9a1e-41c8-4671-93f0-88e4e74edb9d]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:37:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a4ff5b9-dcfc-4ef4-af8c-1dc72de8bfb5 tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:36 devstack sudo[113440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66
Aug 12 16:37:36 devstack sudo[113440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:36 devstack sudo[113440]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a4ff5b9-dcfc-4ef4-af8c-1dc72de8bfb5 tempest-CinderUnicodeTest-179905329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66" returned: 0 in 0.348s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a4ff5b9-dcfc-4ef4-af8c-1dc72de8bfb5 tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:37 devstack sudo[113445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e 1G
Aug 12 16:37:37 devstack sudo[113445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:37 devstack sudo[113445]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a4ff5b9-dcfc-4ef4-af8c-1dc72de8bfb5 tempest-CinderUnicodeTest-179905329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e 1G" returned: 0 in 0.386s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a4ff5b9-dcfc-4ef4-af8c-1dc72de8bfb5 tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:37 devstack sudo[113451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e
Aug 12 16:37:37 devstack sudo[113451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:37 devstack sudo[113451]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a4ff5b9-dcfc-4ef4-af8c-1dc72de8bfb5 tempest-CinderUnicodeTest-179905329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e" returned: 0 in 0.285s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:37 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-2a4ff5b9-dcfc-4ef4-af8c-1dc72de8bfb5 tempest-CinderUnicodeTest-179905329 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e is being set with open permissions: ugo+rw
Aug 12 16:37:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a4ff5b9-dcfc-4ef4-af8c-1dc72de8bfb5 tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:37 devstack sudo[113457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e
Aug 12 16:37:37 devstack sudo[113457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:37 devstack sudo[113457]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a4ff5b9-dcfc-4ef4-af8c-1dc72de8bfb5 tempest-CinderUnicodeTest-179905329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e" returned: 0 in 0.235s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a4ff5b9-dcfc-4ef4-af8c-1dc72de8bfb5 tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:37 devstack sudo[113460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.info
Aug 12 16:37:37 devstack sudo[113460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:38 devstack sudo[113460]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a4ff5b9-dcfc-4ef4-af8c-1dc72de8bfb5 tempest-CinderUnicodeTest-179905329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.info" returned: 0 in 0.242s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:38 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-2a4ff5b9-dcfc-4ef4-af8c-1dc72de8bfb5 tempest-CinderUnicodeTest-179905329 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.info is being set with open permissions: ugo+rw
Aug 12 16:37:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a4ff5b9-dcfc-4ef4-af8c-1dc72de8bfb5 tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:38 devstack sudo[113464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.info
Aug 12 16:37:38 devstack sudo[113464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:38 devstack sudo[113464]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a4ff5b9-dcfc-4ef4-af8c-1dc72de8bfb5 tempest-CinderUnicodeTest-179905329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.info" returned: 0 in 0.240s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2a4ff5b9-dcfc-4ef4-af8c-1dc72de8bfb5 tempest-CinderUnicodeTest-179905329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.816s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:38 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-2a4ff5b9-dcfc-4ef4-af8c-1dc72de8bfb5 tempest-CinderUnicodeTest-179905329 None] Create snapshot completed successfully
Aug 12 16:37:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] Acquiring lock "cinder-f7888da9-0860-4e8a-8da7-391bfff6d57e-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] Lock "cinder-f7888da9-0860-4e8a-8da7-391bfff6d57e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] Acquiring lock "cinder-quobyte-73bf75a2-c7a0-46b8-84f1-e996b6135a66" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] Lock "cinder-quobyte-73bf75a2-c7a0-46b8-84f1-e996b6135a66" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] Acquiring lock "cinder-quobyte-f7888da9-0860-4e8a-8da7-391bfff6d57e" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] Lock "cinder-quobyte-f7888da9-0860-4e8a-8da7-391bfff6d57e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] Deleting offline snapshot f7888da9-0860-4e8a-8da7-391bfff6d57e of volume 73bf75a2-c7a0-46b8-84f1-e996b6135a66 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:37:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] snapshot_file for this snap is: volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:37:38 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1b36e6-3cdb-4421-8bd7-7cd18e299735]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:37:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:38 devstack sudo[113467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e
Aug 12 16:37:38 devstack sudo[113467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:39 devstack sudo[113467]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e" returned: 0 in 0.350s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:37:39 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[950e1b81-87ec-4d5b-9d43-c997a3f42948]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:37:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:39 devstack sudo[113472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66
Aug 12 16:37:39 devstack sudo[113472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:39 devstack sudo[113472]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66" returned: 0 in 0.350s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:39 devstack sudo[113477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e
Aug 12 16:37:39 devstack sudo[113477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:39 devstack sudo[113477]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e" returned: 0 in 0.335s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:39 devstack sudo[113482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e
Aug 12 16:37:39 devstack sudo[113482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:40 devstack sudo[113482]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66.f7888da9-0860-4e8a-8da7-391bfff6d57e" returned: 0 in 0.235s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] Lock "cinder-quobyte-f7888da9-0860-4e8a-8da7-391bfff6d57e" released by "_delete_snapshot" :: held 1.366s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] Lock "cinder-quobyte-73bf75a2-c7a0-46b8-84f1-e996b6135a66" released by "delete_snapshot" :: held 1.389s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:40 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] Created reservations ['a9077e3f-1d07-479a-a95f-609a5439ff02', '5e2f1b5b-33d2-47f7-b58c-088a43e6498f', '2048350f-cd6f-49c1-a5a2-15f9e108c575', 'be99ff3b-5332-4991-8051-56808c13ca88'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:37:40 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] Delete snapshot completed successfully.
Aug 12 16:37:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a835cb22-5a21-45f5-a572-8e58cac2ab26 tempest-CinderUnicodeTest-179905329 None] Lock "cinder-f7888da9-0860-4e8a-8da7-391bfff6d57e-delete_snapshot" released by "delete_snapshot" :: held 1.523s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] Acquiring lock "cinder-73bf75a2-c7a0-46b8-84f1-e996b6135a66-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] Lock "cinder-73bf75a2-c7a0-46b8-84f1-e996b6135a66-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] Acquiring lock "cinder-quobyte-73bf75a2-c7a0-46b8-84f1-e996b6135a66" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] Lock "cinder-quobyte-73bf75a2-c7a0-46b8-84f1-e996b6135a66" acquired by "delete_volume" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:40 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dd2031-2165-4a62-b13a-f9e65332556c]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:37:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:41 devstack sudo[113488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66
Aug 12 16:37:41 devstack sudo[113488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:41 devstack sudo[113488]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66" returned: 0 in 0.348s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:41 devstack sudo[113493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66
Aug 12 16:37:41 devstack sudo[113493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:41 devstack sudo[113493]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-73bf75a2-c7a0-46b8-84f1-e996b6135a66" returned: 0 in 0.244s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] Lock "cinder-quobyte-73bf75a2-c7a0-46b8-84f1-e996b6135a66" released by "delete_volume" :: held 0.648s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:41 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] Created reservations ['3d3111e8-1934-4017-9378-a5b33684d67e', '0898fe7f-f148-46f8-9c5a-c2165e803f31', '3c5950d5-e5cd-41ed-a656-27bf846ca845', '2846aea9-9ec9-41e9-a6ce-6975e494d6a5'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:37:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:41 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:37:41 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:37:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:41 devstack sudo[113496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:37:41 devstack sudo[113496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:41 devstack sudo[113496]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.238s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:41 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:37:41 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] Deleted volume successfully.
Aug 12 16:37:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e5d5234c-21ee-455b-9508-834f343bbe7f tempest-CinderUnicodeTest-179905329 None] Lock "cinder-73bf75a2-c7a0-46b8-84f1-e996b6135a66-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] Acquiring lock "cinder-dbbe2c2a-6541-4d98-b72c-a01e132f8386-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] Lock "cinder-dbbe2c2a-6541-4d98-b72c-a01e132f8386-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] Acquiring lock "cinder-quobyte-dbbe2c2a-6541-4d98-b72c-a01e132f8386" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] Lock "cinder-quobyte-dbbe2c2a-6541-4d98-b72c-a01e132f8386" acquired by "delete_volume" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:42 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b27a94-8c2d-430d-a7e4-c76b70273dc4]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:37:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dbbe2c2a-6541-4d98-b72c-a01e132f8386 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:42 devstack sudo[113499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dbbe2c2a-6541-4d98-b72c-a01e132f8386
Aug 12 16:37:42 devstack sudo[113499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:42 devstack sudo[113499]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dbbe2c2a-6541-4d98-b72c-a01e132f8386" returned: 0 in 0.372s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dbbe2c2a-6541-4d98-b72c-a01e132f8386 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:42 devstack sudo[113504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dbbe2c2a-6541-4d98-b72c-a01e132f8386
Aug 12 16:37:42 devstack sudo[113504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:42 devstack sudo[113504]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-dbbe2c2a-6541-4d98-b72c-a01e132f8386" returned: 0 in 0.239s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] Lock "cinder-quobyte-dbbe2c2a-6541-4d98-b72c-a01e132f8386" released by "delete_volume" :: held 0.651s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:42 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] Created reservations ['91b817e7-f496-4be6-b15b-efc2b4440e61', '45e54fe3-41ac-4599-9c39-e72f953507c5', 'ae1aaec8-f9a2-4df9-b3bb-5dba90812d95', 'd3256864-52d2-4655-aeec-9c56112c14f4'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:37:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:37:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:37:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:42 devstack sudo[113507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:37:42 devstack sudo[113507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:43 devstack sudo[113507]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.232s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:43 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:37:43 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] Deleted volume successfully.
Aug 12 16:37:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-fe0b6915-78b4-4fd3-89d1-e2dc0bc1f907 tempest-CinderUnicodeTest-179905329 None] Lock "cinder-dbbe2c2a-6541-4d98-b72c-a01e132f8386-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Flow 'volume_create_manager' (5b754035-b983-4c36-84d8-d80182445f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e281685-2625-43ce-b975-a144cc17a8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e281685-2625-43ce-b975-a144cc17a8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582741454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39fc311-6ba2-4b2b-b8fb-33becf802bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab4025aecac45419b378fc83184ace0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:37:46Z,use_quota=True,user_id='b3a9a653f2ec40969042684a094ae73d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70651719-0512-4c16-9be3-df396398b64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70651719-0512-4c16-9be3-df396398b64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f56848-4c6e-4ebe-a343-18b90d0bf4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f56848-4c6e-4ebe-a343-18b90d0bf4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c39fc311-6ba2-4b2b-b8fb-33becf802bca', 'volume_name': 'volume-c39fc311-6ba2-4b2b-b8fb-33becf802bca', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8397c8c0-fe29-4bdb-a424-2c4a7488ab74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8397c8c0-fe29-4bdb-a424-2c4a7488ab74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab5e7dd-1921-498a-a9a3-914f1659dc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:46 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Volume c39fc311-6ba2-4b2b-b8fb-33becf802bca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c39fc311-6ba2-4b2b-b8fb-33becf802bca', 'volume_size': 1}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582741454',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c39fc311-6ba2-4b2b-b8fb-33becf802bca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab4025aecac45419b378fc83184ace0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:37:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:37:46Z,use_quota=True,user_id='b3a9a653f2ec40969042684a094ae73d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Creating volume c39fc311-6ba2-4b2b-b8fb-33becf802bca {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:37:46 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c39fc311-6ba2-4b2b-b8fb-33becf802bca 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:46 devstack sudo[113510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c39fc311-6ba2-4b2b-b8fb-33becf802bca 1073741824
Aug 12 16:37:46 devstack sudo[113510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:46 devstack sudo[113510]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c39fc311-6ba2-4b2b-b8fb-33becf802bca 1073741824" returned: 0 in 0.396s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c39fc311-6ba2-4b2b-b8fb-33becf802bca {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:46 devstack sudo[113515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c39fc311-6ba2-4b2b-b8fb-33becf802bca
Aug 12 16:37:46 devstack sudo[113515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:47 devstack sudo[113515]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c39fc311-6ba2-4b2b-b8fb-33becf802bca" returned: 0 in 0.232s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:37:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aab5e7dd-1921-498a-a9a3-914f1659dc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c39fc311-6ba2-4b2b-b8fb-33becf802bca', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c48b1d1-5ddc-4475-94b6-9031f9eb20c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:47 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Volume volume-c39fc311-6ba2-4b2b-b8fb-33becf802bca (c39fc311-6ba2-4b2b-b8fb-33becf802bca): created successfully
Aug 12 16:37:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c48b1d1-5ddc-4475-94b6-9031f9eb20c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Flow 'volume_create_manager' (5b754035-b983-4c36-84d8-d80182445f61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:37:47 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-43ed881a-c8ca-4df3-934b-acec2fd4ec72 tempest-ProjectReaderTests-1106707435 None] Created volume successfully.
Aug 12 16:37:47 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] Acquiring lock "cinder-c39fc311-6ba2-4b2b-b8fb-33becf802bca-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:47 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] Lock "cinder-c39fc311-6ba2-4b2b-b8fb-33becf802bca-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:47 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] Acquiring lock "cinder-quobyte-c39fc311-6ba2-4b2b-b8fb-33becf802bca" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:47 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] Lock "cinder-quobyte-c39fc311-6ba2-4b2b-b8fb-33becf802bca" acquired by "delete_volume" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:47 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d755faf4-eb27-47f3-88dd-d161a0a5915e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:37:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c39fc311-6ba2-4b2b-b8fb-33becf802bca {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:47 devstack sudo[113518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c39fc311-6ba2-4b2b-b8fb-33becf802bca
Aug 12 16:37:47 devstack sudo[113518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:47 devstack sudo[113518]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c39fc311-6ba2-4b2b-b8fb-33becf802bca" returned: 0 in 0.345s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c39fc311-6ba2-4b2b-b8fb-33becf802bca {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:47 devstack sudo[113523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c39fc311-6ba2-4b2b-b8fb-33becf802bca
Aug 12 16:37:47 devstack sudo[113523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:48 devstack sudo[113523]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c39fc311-6ba2-4b2b-b8fb-33becf802bca" returned: 0 in 0.244s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] Lock "cinder-quobyte-c39fc311-6ba2-4b2b-b8fb-33becf802bca" released by "delete_volume" :: held 0.625s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:48 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] Created reservations ['9ec01616-3b8e-48e6-819e-88ad8ddcc6b0', 'ab8cac86-ad3d-4584-92ea-1ac482e4832a', '4bdac52a-3b83-4919-a486-2f736a48a685', 'b3720744-9b95-4254-bba0-35044966410a'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:37:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:37:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:37:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:48 devstack sudo[113526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:37:48 devstack sudo[113526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:48 devstack sudo[113526]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.242s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:48 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:37:48 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] Deleted volume successfully.
Aug 12 16:37:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-809a1ecd-ae3f-40f7-a974-38ea9f2c4785 tempest-ProjectReaderTests-1106707435 None] Lock "cinder-c39fc311-6ba2-4b2b-b8fb-33becf802bca-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Flow 'volume_create_manager' (0dd0e0f9-32f1-4534-91c6-298fb2ee9781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9965c0f6-672d-4cb6-9469-7421215bd2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9965c0f6-672d-4cb6-9469-7421215bd2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-440636145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2570b1c7-182d-424e-8f3f-227e3bf78441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab4025aecac45419b378fc83184ace0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:37:49Z,use_quota=True,user_id='b3a9a653f2ec40969042684a094ae73d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d92e5b54-cdfc-4d83-8be2-3b3fe18cb833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d92e5b54-cdfc-4d83-8be2-3b3fe18cb833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe319fb-29c4-49e6-acea-75ba9f3b4e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe319fb-29c4-49e6-acea-75ba9f3b4e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2570b1c7-182d-424e-8f3f-227e3bf78441', 'volume_name': 'volume-2570b1c7-182d-424e-8f3f-227e3bf78441', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9e49b9-8392-41df-ba71-6cb2584ad6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9e49b9-8392-41df-ba71-6cb2584ad6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676bd266-2275-44f6-9ea9-ca2b60fbc880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:49 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Volume 2570b1c7-182d-424e-8f3f-227e3bf78441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2570b1c7-182d-424e-8f3f-227e3bf78441', 'volume_size': 1}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-440636145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2570b1c7-182d-424e-8f3f-227e3bf78441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab4025aecac45419b378fc83184ace0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:37:49Z,use_quota=True,user_id='b3a9a653f2ec40969042684a094ae73d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Creating volume 2570b1c7-182d-424e-8f3f-227e3bf78441 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:37:49 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2570b1c7-182d-424e-8f3f-227e3bf78441 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:49 devstack sudo[113529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2570b1c7-182d-424e-8f3f-227e3bf78441 1073741824
Aug 12 16:37:49 devstack sudo[113529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:49 devstack sudo[113529]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2570b1c7-182d-424e-8f3f-227e3bf78441 1073741824" returned: 0 in 0.415s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2570b1c7-182d-424e-8f3f-227e3bf78441 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:49 devstack sudo[113535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2570b1c7-182d-424e-8f3f-227e3bf78441
Aug 12 16:37:49 devstack sudo[113535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:49 devstack sudo[113535]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2570b1c7-182d-424e-8f3f-227e3bf78441" returned: 0 in 0.236s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676bd266-2275-44f6-9ea9-ca2b60fbc880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2570b1c7-182d-424e-8f3f-227e3bf78441', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc9973d-2272-416e-a731-5e6925106c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:37:49 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Volume volume-2570b1c7-182d-424e-8f3f-227e3bf78441 (2570b1c7-182d-424e-8f3f-227e3bf78441): created successfully
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc9973d-2272-416e-a731-5e6925106c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:37:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Flow 'volume_create_manager' (0dd0e0f9-32f1-4534-91c6-298fb2ee9781) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:37:49 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-3fc9c626-6f46-465e-8e6a-ca72924244e1 tempest-ProjectReaderTests-1106707435 None] Created volume successfully.
Aug 12 16:37:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] Acquiring lock "cinder-2570b1c7-182d-424e-8f3f-227e3bf78441-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] Lock "cinder-2570b1c7-182d-424e-8f3f-227e3bf78441-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] Acquiring lock "cinder-quobyte-2570b1c7-182d-424e-8f3f-227e3bf78441" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:37:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] Lock "cinder-quobyte-2570b1c7-182d-424e-8f3f-227e3bf78441" acquired by "delete_volume" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:37:50 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd2e4ef-992e-4941-b80f-c8197aab9f89]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:37:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2570b1c7-182d-424e-8f3f-227e3bf78441 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:50 devstack sudo[113538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2570b1c7-182d-424e-8f3f-227e3bf78441
Aug 12 16:37:50 devstack sudo[113538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:50 devstack sudo[113538]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2570b1c7-182d-424e-8f3f-227e3bf78441" returned: 0 in 0.370s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2570b1c7-182d-424e-8f3f-227e3bf78441 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:50 devstack sudo[113544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2570b1c7-182d-424e-8f3f-227e3bf78441
Aug 12 16:37:50 devstack sudo[113544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:50 devstack sudo[113544]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2570b1c7-182d-424e-8f3f-227e3bf78441" returned: 0 in 0.244s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] Lock "cinder-quobyte-2570b1c7-182d-424e-8f3f-227e3bf78441" released by "delete_volume" :: held 0.651s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:37:50 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] Created reservations ['8b1f9d64-49fd-409a-b878-40f31d0ef2ad', 'c33bd703-6ee5-4bb1-bfcf-d7eefe57ac53', 'cadac304-cc35-430a-a6f2-c0ca91647d61', '7f299163-70c2-4756-a498-d509a4da131f'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:37:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:37:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:37:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:37:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:37:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:37:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:37:50 devstack sudo[113547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:37:50 devstack sudo[113547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:37:51 devstack sudo[113547]: pam_unix(sudo:session): session closed for user root
Aug 12 16:37:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.240s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:37:51 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:37:51 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] Deleted volume successfully.
Aug 12 16:37:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-09efd65f-f412-426e-b6c4-7f0d5ce7b547 tempest-ProjectReaderTests-1106707435 None] Lock "cinder-2570b1c7-182d-424e-8f3f-227e3bf78441-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:00 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:UPDATE=56,cinder:SELECT=36,cinder:DELETE=4,cinder:INSERT=12 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:38:01 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=38,cinder:UPDATE=46,cinder:INSERT=13,cinder:DELETE=5 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Flow 'volume_create_manager' (f03cec62-955a-47a9-ae97-91ae4898705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307ae889-6483-4493-9008-e788339a00dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307ae889-6483-4493-9008-e788339a00dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-998143983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1145362f-b890-4382-ac22-986e757067e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd39b71438f54c85b45d5c0ba3608d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:03Z,use_quota=True,user_id='b4f28ce856d0458b953bf4cc71ba4ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfccd16-1dbe-45c3-8c61-74aed18fa22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bfccd16-1dbe-45c3-8c61-74aed18fa22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f06e551-6d95-4570-8076-b9441e33caef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f06e551-6d95-4570-8076-b9441e33caef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1145362f-b890-4382-ac22-986e757067e2', 'volume_name': 'volume-1145362f-b890-4382-ac22-986e757067e2', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c964b02b-e463-4ff3-9304-460717736780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c964b02b-e463-4ff3-9304-460717736780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4904197-b84b-4337-a12b-f8fbb3ff4a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:03 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Volume 1145362f-b890-4382-ac22-986e757067e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1145362f-b890-4382-ac22-986e757067e2', 'volume_size': 1}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-998143983',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1145362f-b890-4382-ac22-986e757067e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd39b71438f54c85b45d5c0ba3608d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:03Z,use_quota=True,user_id='b4f28ce856d0458b953bf4cc71ba4ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Creating volume 1145362f-b890-4382-ac22-986e757067e2 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:03 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:03 devstack sudo[113588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2 1073741824
Aug 12 16:38:03 devstack sudo[113588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Flow 'volume_create_manager' (6b804546-2c92-4370-bd9b-87de64a4d899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e09bf2-dbae-49b6-bd28-512ce1b2e6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e09bf2-dbae-49b6-bd28-512ce1b2e6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-699498228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f959f4-c13a-4ed6-8267-e3e5399e1ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbbcf4bfb5549569e26e2de02feb5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:03Z,use_quota=True,user_id='62956d39d68543e28510b6ec7b3a9c70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683de5fd-6371-4011-88c5-32ad78370e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683de5fd-6371-4011-88c5-32ad78370e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cead12e-e7fa-45ca-8313-0026f416b347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cead12e-e7fa-45ca-8313-0026f416b347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f959f4-c13a-4ed6-8267-e3e5399e1ccb', 'volume_name': 'volume-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67e33e0-0278-415e-ae45-ebabcd24a2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b67e33e0-0278-415e-ae45-ebabcd24a2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770638fa-990c-4673-b92e-bd1862fd98aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:03 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Volume b2f959f4-c13a-4ed6-8267-e3e5399e1ccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb', 'volume_size': 1}
Aug 12 16:38:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:04 devstack sudo[113588]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2 1073741824" returned: 0 in 0.766s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Flow 'volume_create_manager' (4b51e765-4ecf-412c-b9f7-2128596a08ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7e6134-c117-4569-a96f-81786332be3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Flow 'volume_create_manager' (07caf108-58f2-41bf-9827-2a09e94a0459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b65d29-5e75-49b5-ae2e-ae759b3cd83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7e6134-c117-4569-a96f-81786332be3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1712208449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce13bed-7dbc-4725-8402-3b164e1bc932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbbcf4bfb5549569e26e2de02feb5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:04Z,use_quota=True,user_id='62956d39d68543e28510b6ec7b3a9c70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b541409-cd94-4503-88e2-caf4bd6a3a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b541409-cd94-4503-88e2-caf4bd6a3a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2c01cb-3498-433c-b747-bffd9e9de2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d2c01cb-3498-433c-b747-bffd9e9de2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ce13bed-7dbc-4725-8402-3b164e1bc932', 'volume_name': 'volume-7ce13bed-7dbc-4725-8402-3b164e1bc932', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31b1ef0-9263-4d10-b7f8-a2acf671281b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b31b1ef0-9263-4d10-b7f8-a2acf671281b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe058e2-4706-482a-8a28-57095e2d7ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:04 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Volume 7ce13bed-7dbc-4725-8402-3b164e1bc932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ce13bed-7dbc-4725-8402-3b164e1bc932', 'volume_size': 1}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03b65d29-5e75-49b5-ae2e-ae759b3cd83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-796664077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3c219b-8d23-493a-be83-838759e00ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbbcf4bfb5549569e26e2de02feb5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:04Z,use_quota=True,user_id='62956d39d68543e28510b6ec7b3a9c70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d24b46-4c6d-4c9c-8eb9-e5d6151f0950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d24b46-4c6d-4c9c-8eb9-e5d6151f0950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a932cc-f091-42b6-a9cd-373f3f0b969d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a932cc-f091-42b6-a9cd-373f3f0b969d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c3c219b-8d23-493a-be83-838759e00ea6', 'volume_name': 'volume-3c3c219b-8d23-493a-be83-838759e00ea6', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b400788d-6b93-4e40-a327-fcab7d7350f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b400788d-6b93-4e40-a327-fcab7d7350f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c97cfd6a-ae0e-4e81-91c9-a9600a6a3a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:04 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Volume 3c3c219b-8d23-493a-be83-838759e00ea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c3c219b-8d23-493a-be83-838759e00ea6', 'volume_size': 1}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:04 devstack sudo[113597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2
Aug 12 16:38:04 devstack sudo[113597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Flow 'volume_create_manager' (61965b13-2fc5-4088-927e-4b8ca29ebbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ed1c54-abee-48f6-9480-a5809902a331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ed1c54-abee-48f6-9480-a5809902a331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-180951438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408b3966-6eeb-462d-aef9-4155ec359b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbbcf4bfb5549569e26e2de02feb5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:05Z,use_quota=True,user_id='62956d39d68543e28510b6ec7b3a9c70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca690e6-52d3-4e12-a362-4b26c2cacf8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca690e6-52d3-4e12-a362-4b26c2cacf8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61328af-61e8-4320-89ec-3dc9af86874b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61328af-61e8-4320-89ec-3dc9af86874b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '408b3966-6eeb-462d-aef9-4155ec359b84', 'volume_name': 'volume-408b3966-6eeb-462d-aef9-4155ec359b84', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a514fc9-7f6b-46e9-aac6-3deb783bd388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a514fc9-7f6b-46e9-aac6-3deb783bd388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeac243c-93cd-468b-a35a-cadbb8d841d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:04 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Volume 408b3966-6eeb-462d-aef9-4155ec359b84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-408b3966-6eeb-462d-aef9-4155ec359b84', 'volume_size': 1}
Aug 12 16:38:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:05 devstack sudo[113597]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2" returned: 0 in 0.414s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.298s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-699498228',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f959f4-c13a-4ed6-8267-e3e5399e1ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbbcf4bfb5549569e26e2de02feb5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:03Z,use_quota=True,user_id='62956d39d68543e28510b6ec7b3a9c70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Creating volume b2f959f4-c13a-4ed6-8267-e3e5399e1ccb {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:05 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4904197-b84b-4337-a12b-f8fbb3ff4a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1145362f-b890-4382-ac22-986e757067e2', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:05 devstack sudo[113600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb 1073741824
Aug 12 16:38:05 devstack sudo[113600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e4ee80-9dad-44c0-a35b-bb4702f4411a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:05 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Volume volume-1145362f-b890-4382-ac22-986e757067e2 (1145362f-b890-4382-ac22-986e757067e2): created successfully
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e4ee80-9dad-44c0-a35b-bb4702f4411a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Flow 'volume_create_manager' (f03cec62-955a-47a9-ae97-91ae4898705f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:05 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-04d31c42-c231-4fc0-8f2b-9384c4edf9c7 tempest-VolumeDependencyTests-1141527902 None] Created volume successfully.
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Flow 'volume_create_manager' (8eec94d5-b42f-4eae-bb9c-68ab98732bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00fe1d0-c169-466c-be8a-41d78d2a4cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c00fe1d0-c169-466c-be8a-41d78d2a4cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-73367953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1832a6db-8505-4cc8-829f-011209f2a392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbbcf4bfb5549569e26e2de02feb5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:05Z,use_quota=True,user_id='62956d39d68543e28510b6ec7b3a9c70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abaa9999-730c-4f8d-9d62-9bdebcfd7f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abaa9999-730c-4f8d-9d62-9bdebcfd7f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7118d670-247b-4ba7-96a0-a7cdb7ce276a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7118d670-247b-4ba7-96a0-a7cdb7ce276a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1832a6db-8505-4cc8-829f-011209f2a392', 'volume_name': 'volume-1832a6db-8505-4cc8-829f-011209f2a392', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfab0550-4fb1-4c29-9d39-286ef3c2c641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfab0550-4fb1-4c29-9d39-286ef3c2c641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb4f387-3894-4fe0-a22f-ae5188764b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:05 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Volume 1832a6db-8505-4cc8-829f-011209f2a392: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1832a6db-8505-4cc8-829f-011209f2a392', 'volume_size': 1}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:05 devstack sudo[113600]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb 1073741824" returned: 0 in 0.632s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:05 devstack sudo[113606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb
Aug 12 16:38:05 devstack sudo[113606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:06 devstack sudo[113606]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb" returned: 0 in 0.256s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.498s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1712208449',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce13bed-7dbc-4725-8402-3b164e1bc932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbbcf4bfb5549569e26e2de02feb5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:04Z,use_quota=True,user_id='62956d39d68543e28510b6ec7b3a9c70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Creating volume 7ce13bed-7dbc-4725-8402-3b164e1bc932 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:06 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7ce13bed-7dbc-4725-8402-3b164e1bc932 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770638fa-990c-4673-b92e-bd1862fd98aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1740a9f8-98c2-46a4-a98e-92713e99c9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:06 devstack sudo[113609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7ce13bed-7dbc-4725-8402-3b164e1bc932 1073741824
Aug 12 16:38:06 devstack sudo[113609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:06 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Volume volume-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb (b2f959f4-c13a-4ed6-8267-e3e5399e1ccb): created successfully
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1740a9f8-98c2-46a4-a98e-92713e99c9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Flow 'volume_create_manager' (6b804546-2c92-4370-bd9b-87de64a4d899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:06 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ddc11902-ee55-455a-8ee0-dfb19a9fe7d6 tempest-CreateVolumesFromImageTest-1985922618 None] Created volume successfully.
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Flow 'volume_create_manager' (950f0ee4-db20-45b4-a162-1fb8277bb942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d629ae4-43c8-46b0-b3a4-4f3e2b3c2d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d629ae4-43c8-46b0-b3a4-4f3e2b3c2d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a22601dd-ed04-4fbd-a257-6b925e91da9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c9c76dcccf4564a9efef4dd6a01a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:06Z,use_quota=True,user_id='0cb99f4a8d374272a8c058f766e70745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78296dbd-7ff0-4ec2-bc27-60c9d5a23d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78296dbd-7ff0-4ec2-bc27-60c9d5a23d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f70c63-f4dc-4bad-95c4-775b0d52eecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.image.glance [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Creating Keystone auth plugin from conf {{(pid=94457) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-18a27972-e96b-4626-8828-95430f9712b3 tempest-VolumeDependencyTests-1141527902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:06 devstack sudo[113609]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7ce13bed-7dbc-4725-8402-3b164e1bc932 1073741824" returned: 0 in 0.625s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7ce13bed-7dbc-4725-8402-3b164e1bc932 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:06 devstack sudo[113616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7ce13bed-7dbc-4725-8402-3b164e1bc932
Aug 12 16:38:06 devstack sudo[113616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f70c63-f4dc-4bad-95c4-775b0d52eecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a22601dd-ed04-4fbd-a257-6b925e91da9d', 'volume_name': 'volume-a22601dd-ed04-4fbd-a257-6b925e91da9d', 'volume_size': 1, 'image_id': '2dad45bb-73b3-409c-9989-03c6b404f7f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2dad45bb-73b3-409c-9989-03c6b404f7f6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '84293846277f6d5328e0486cb41ef6c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a2c9c76dcccf4564a9efef4dd6a01a7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1643106f4b8a813a3b6716f4daaa8978cfb8d8fb9ebc9a098ce54e5d94af6a5065dd46b0dbc83669e21117a9384f09741268515dec4f06fec3c57b8ef71c8bf3', 'id': '2dad45bb-73b3-409c-9989-03c6b404f7f6', 'created_at': datetime.datetime(2026, 8, 12, 14, 38, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 38, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2dad45bb-73b3-409c-9989-03c6b404f7f6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b633b1d90>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438ce6f0-9a4f-4082-84e6-005c9afcac37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438ce6f0-9a4f-4082-84e6-005c9afcac37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7394eeab-c812-45a4-b60e-add4a6f4f482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:06 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Volume a22601dd-ed04-4fbd-a257-6b925e91da9d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a22601dd-ed04-4fbd-a257-6b925e91da9d', 'volume_size': 1, 'image_id': '2dad45bb-73b3-409c-9989-03c6b404f7f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2dad45bb-73b3-409c-9989-03c6b404f7f6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '84293846277f6d5328e0486cb41ef6c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a2c9c76dcccf4564a9efef4dd6a01a7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1643106f4b8a813a3b6716f4daaa8978cfb8d8fb9ebc9a098ce54e5d94af6a5065dd46b0dbc83669e21117a9384f09741268515dec4f06fec3c57b8ef71c8bf3', 'id': '2dad45bb-73b3-409c-9989-03c6b404f7f6', 'created_at': datetime.datetime(2026, 8, 12, 14, 38, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 38, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2dad45bb-73b3-409c-9989-03c6b404f7f6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b633b1d90>}
Aug 12 16:38:06 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Trying to clone a22601dd-ed04-4fbd-a257-6b925e91da9d from image 2dad45bb-73b3-409c-9989-03c6b404f7f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2dad45bb-73b3-409c-9989-03c6b404f7f6', 'metadata': {}}]). {{(pid=94457) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 12 16:38:07 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Image download 0.00 MB at 0.00 MB/s
Aug 12 16:38:07 devstack sudo[113616]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7ce13bed-7dbc-4725-8402-3b164e1bc932" returned: 0 in 0.279s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.373s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-796664077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c3c219b-8d23-493a-be83-838759e00ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbbcf4bfb5549569e26e2de02feb5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:04Z,use_quota=True,user_id='62956d39d68543e28510b6ec7b3a9c70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Creating volume 3c3c219b-8d23-493a-be83-838759e00ea6 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:07 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3c3c219b-8d23-493a-be83-838759e00ea6 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe058e2-4706-482a-8a28-57095e2d7ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ce13bed-7dbc-4725-8402-3b164e1bc932', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:07 devstack sudo[113619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3c3c219b-8d23-493a-be83-838759e00ea6 1073741824
Aug 12 16:38:07 devstack sudo[113619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084f791f-e04d-4901-8491-915a44dc1737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e8c691-0123-4df8-a9ec-3b1fa4c878f5]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:07 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Volume volume-7ce13bed-7dbc-4725-8402-3b164e1bc932 (7ce13bed-7dbc-4725-8402-3b164e1bc932): created successfully
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084f791f-e04d-4901-8491-915a44dc1737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Flow 'volume_create_manager' (4b51e765-4ecf-412c-b9f7-2128596a08ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:07 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-4630c273-e424-4487-8643-9188efbf7ed1 tempest-CreateVolumesFromImageTest-1985922618 None] Created volume successfully.
Aug 12 16:38:07 devstack sudo[113621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD
Aug 12 16:38:07 devstack sudo[113621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:07 devstack sudo[113621]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:07 devstack sudo[113619]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3c3c219b-8d23-493a-be83-838759e00ea6 1073741824" returned: 0 in 0.556s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:07 devstack sudo[113629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3c3c219b-8d23-493a-be83-838759e00ea6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:07 devstack sudo[113629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:07 devstack sudo[113631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3c3c219b-8d23-493a-be83-838759e00ea6
Aug 12 16:38:07 devstack sudo[113631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Flow 'volume_create_manager' (cbaab1fd-a2c7-4846-ba7b-38724a047d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c435d1-5aa9-4140-8f50-5fcfed2858db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c435d1-5aa9-4140-8f50-5fcfed2858db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adee8da0-ab9b-4646-b097-0fe596106413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ac2ededee944d39fa320943f091b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:08Z,use_quota=True,user_id='96c9830a8c4b4c4397c78a0eb38ead0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89f08076-fefe-4733-99a4-704b99a429f2),volume_type_id=89f08076-fefe-4733-99a4-704b99a429f2)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecd79fd-1f8e-411d-8aad-5c2288d7e552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fecd79fd-1f8e-411d-8aad-5c2288d7e552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd520dd3-7642-4074-a972-e48756164cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.image.glance [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Creating Keystone auth plugin from conf {{(pid=94457) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Aug 12 16:38:07 devstack sudo[113629]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Temporary image 2dad45bb-73b3-409c-9989-03c6b404f7f6 is fetched for user 0cb99f4a8d374272a8c058f766e70745. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 12 16:38:07 devstack sudo[113631]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3c3c219b-8d23-493a-be83-838759e00ea6" returned: 0 in 0.265s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.066s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-180951438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408b3966-6eeb-462d-aef9-4155ec359b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbbcf4bfb5549569e26e2de02feb5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:05Z,use_quota=True,user_id='62956d39d68543e28510b6ec7b3a9c70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Creating volume 408b3966-6eeb-462d-aef9-4155ec359b84 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:07 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-408b3966-6eeb-462d-aef9-4155ec359b84 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:08 devstack sudo[113637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-408b3966-6eeb-462d-aef9-4155ec359b84 1073741824
Aug 12 16:38:08 devstack sudo[113637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c97cfd6a-ae0e-4e81-91c9-a9600a6a3a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c3c219b-8d23-493a-be83-838759e00ea6', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e065f926-0a17-44a2-a546-c0291f346d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:08 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Volume volume-3c3c219b-8d23-493a-be83-838759e00ea6 (3c3c219b-8d23-493a-be83-838759e00ea6): created successfully
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e065f926-0a17-44a2-a546-c0291f346d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Flow 'volume_create_manager' (07caf108-58f2-41bf-9827-2a09e94a0459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd520dd3-7642-4074-a972-e48756164cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'adee8da0-ab9b-4646-b097-0fe596106413', 'volume_name': 'volume-adee8da0-ab9b-4646-b097-0fe596106413', 'volume_size': 1, 'image_id': '46edea08-6234-4146-b548-7fba8ee99636', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46edea08-6234-4146-b548-7fba8ee99636', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'adb3d748e1d732d2c064dcce4a87dfec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '33ac2ededee944d39fa320943f091b45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3f30e92fd9863493148290058730b3be413466132a6bcbe5d812387ab623f6ed99725c769d6b9f5c35b13be89afd834d8c2a292b6c48304375c292e3a792220e', 'id': '46edea08-6234-4146-b548-7fba8ee99636', 'created_at': datetime.datetime(2026, 8, 12, 14, 38, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 38, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46edea08-6234-4146-b548-7fba8ee99636/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b63660cb0>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e31ba0-0c5f-497e-ad5c-c2f254a5f607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e31ba0-0c5f-497e-ad5c-c2f254a5f607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (336d034e-e6f3-4a50-9a8b-1ae56fb3b049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:08 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Volume adee8da0-ab9b-4646-b097-0fe596106413: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-adee8da0-ab9b-4646-b097-0fe596106413', 'volume_size': 1, 'image_id': '46edea08-6234-4146-b548-7fba8ee99636', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46edea08-6234-4146-b548-7fba8ee99636', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'adb3d748e1d732d2c064dcce4a87dfec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '33ac2ededee944d39fa320943f091b45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3f30e92fd9863493148290058730b3be413466132a6bcbe5d812387ab623f6ed99725c769d6b9f5c35b13be89afd834d8c2a292b6c48304375c292e3a792220e', 'id': '46edea08-6234-4146-b548-7fba8ee99636', 'created_at': datetime.datetime(2026, 8, 12, 14, 38, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 38, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46edea08-6234-4146-b548-7fba8ee99636/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b63660cb0>}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Trying to clone adee8da0-ab9b-4646-b097-0fe596106413 from image 46edea08-6234-4146-b548-7fba8ee99636 at location (None, [{'url': 'file:///opt/stack/data/glance/images/46edea08-6234-4146-b548-7fba8ee99636', 'metadata': {}}]). {{(pid=94457) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[3419243c-7208-4bdb-b2a4-d0702d9b5396]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:08 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-1298f899-8fdf-451f-9861-61b58c1b0baa tempest-CreateVolumesFromImageTest-1985922618 None] Created volume successfully.
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Aug 12 16:38:08 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Image download 0.00 MB at 0.00 MB/s
Aug 12 16:38:08 devstack sudo[113639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD
Aug 12 16:38:08 devstack sudo[113639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab89020c-6de4-4862-a06c-9bef3f0db102]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:08 devstack sudo[113644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD
Aug 12 16:38:08 devstack sudo[113644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:08 devstack sudo[113637]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-408b3966-6eeb-462d-aef9-4155ec359b84 1073741824" returned: 0 in 0.475s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:08 devstack sudo[113639]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-408b3966-6eeb-462d-aef9-4155ec359b84 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:08 devstack sudo[113649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-408b3966-6eeb-462d-aef9-4155ec359b84
Aug 12 16:38:08 devstack sudo[113649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:08 devstack sudo[113648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD
Aug 12 16:38:08 devstack sudo[113648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:08 devstack sudo[113644]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:08 devstack sudo[113656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD
Aug 12 16:38:08 devstack sudo[113656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:08 devstack sudo[113649]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-408b3966-6eeb-462d-aef9-4155ec359b84" returned: 0 in 0.307s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.251s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-73367953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1832a6db-8505-4cc8-829f-011209f2a392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dbbcf4bfb5549569e26e2de02feb5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:05Z,use_quota=True,user_id='62956d39d68543e28510b6ec7b3a9c70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Creating volume 1832a6db-8505-4cc8-829f-011209f2a392 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:08 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1832a6db-8505-4cc8-829f-011209f2a392 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeac243c-93cd-468b-a35a-cadbb8d841d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-408b3966-6eeb-462d-aef9-4155ec359b84', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:08 devstack sudo[113662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1832a6db-8505-4cc8-829f-011209f2a392 1073741824
Aug 12 16:38:08 devstack sudo[113662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:08 devstack sudo[113648]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c4122b-42ef-4d1c-9f5c-ffa6ffb0a901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD" returned: 1 in 0.398s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:08 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Volume volume-408b3966-6eeb-462d-aef9-4155ec359b84 (408b3966-6eeb-462d-aef9-4155ec359b84): created successfully
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c4122b-42ef-4d1c-9f5c-ffa6ffb0a901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Flow 'volume_create_manager' (61965b13-2fc5-4088-927e-4b8ca29ebbf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:08 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-78c12fbf-7d8e-424d-a58a-ab1804e41bba tempest-CreateVolumesFromImageTest-1985922618 None] Created volume successfully.
Aug 12 16:38:09 devstack sudo[113656]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD" returned: 1 in 0.387s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Temporary image 46edea08-6234-4146-b548-7fba8ee99636 is fetched for user 96c9830a8c4b4c4397c78a0eb38ead0f. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[5242fa26-8e13-499e-b034-df67fb5ccb0d]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:09 devstack sudo[113669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD
Aug 12 16:38:09 devstack sudo[113669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:09 devstack sudo[113662]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1832a6db-8505-4cc8-829f-011209f2a392 1073741824" returned: 0 in 0.459s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1832a6db-8505-4cc8-829f-011209f2a392 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:09 devstack sudo[113673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1832a6db-8505-4cc8-829f-011209f2a392
Aug 12 16:38:09 devstack sudo[113673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:09 devstack sudo[113669]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:09 devstack sudo[113677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD
Aug 12 16:38:09 devstack sudo[113677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:09 devstack sudo[113673]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1832a6db-8505-4cc8-829f-011209f2a392" returned: 0 in 0.274s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-18a27972-e96b-4626-8828-95430f9712b3 tempest-VolumeDependencyTests-1141527902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.865s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb4f387-3894-4fe0-a22f-ae5188764b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1832a6db-8505-4cc8-829f-011209f2a392', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7833eeae-3a42-4452-ad32-d9ec36c958ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-18a27972-e96b-4626-8828-95430f9712b3 tempest-VolumeDependencyTests-1141527902 None] Creating offline snapshot 6ca86716-e5a3-42ce-a184-0f23b3e6b897 of volume 1145362f-b890-4382-ac22-986e757067e2 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:38:09 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Volume volume-1832a6db-8505-4cc8-829f-011209f2a392 (1832a6db-8505-4cc8-829f-011209f2a392): created successfully
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7833eeae-3a42-4452-ad32-d9ec36c958ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Flow 'volume_create_manager' (8eec94d5-b42f-4eae-bb9c-68ab98732bb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[2976b7fe-0010-43a9-90ef-69c407f34c04]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-18a27972-e96b-4626-8828-95430f9712b3 tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:09 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-44ebc62b-a9dc-4307-a82d-221ae19e4574 tempest-CreateVolumesFromImageTest-1985922618 None] Created volume successfully.
Aug 12 16:38:09 devstack sudo[113677]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:09 devstack sudo[113680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2
Aug 12 16:38:09 devstack sudo[113680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "cinder-1832a6db-8505-4cc8-829f-011209f2a392-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-1832a6db-8505-4cc8-829f-011209f2a392-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "cinder-quobyte-1832a6db-8505-4cc8-829f-011209f2a392" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-quobyte-1832a6db-8505-4cc8-829f-011209f2a392" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ed77f2-721c-4146-8b65-10e83d766b32]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1832a6db-8505-4cc8-829f-011209f2a392 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:10 devstack sudo[113680]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-18a27972-e96b-4626-8828-95430f9712b3 tempest-VolumeDependencyTests-1141527902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2" returned: 0 in 0.400s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-18a27972-e96b-4626-8828-95430f9712b3 tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:10 devstack sudo[113690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897 1G
Aug 12 16:38:10 devstack sudo[113690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:10 devstack sudo[113689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1832a6db-8505-4cc8-829f-011209f2a392
Aug 12 16:38:10 devstack sudo[113689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:10 devstack sudo[113689]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1832a6db-8505-4cc8-829f-011209f2a392" returned: 0 in 0.380s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1832a6db-8505-4cc8-829f-011209f2a392 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:10 devstack sudo[113700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1832a6db-8505-4cc8-829f-011209f2a392
Aug 12 16:38:10 devstack sudo[113700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:10 devstack sudo[113690]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-18a27972-e96b-4626-8828-95430f9712b3 tempest-VolumeDependencyTests-1141527902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897 1G" returned: 0 in 0.406s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-18a27972-e96b-4626-8828-95430f9712b3 tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1145362f-b890-4382-ac22-986e757067e2 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:10 devstack sudo[113703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1145362f-b890-4382-ac22-986e757067e2 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897
Aug 12 16:38:10 devstack sudo[113703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:10 devstack sudo[113700]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1832a6db-8505-4cc8-829f-011209f2a392" returned: 0 in 0.258s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-quobyte-1832a6db-8505-4cc8-829f-011209f2a392" released by "delete_volume" :: held 0.681s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] Created reservations ['8a6ab28b-5a3c-4447-a4ad-ff7c9fc7d215', 'd3ebe535-7a20-4349-b95d-7af61da0f542', '82ecf097-427e-477c-bba6-3b9402a7d1b6', 'ae0da89f-03da-4b6c-8347-1e002c0885ea'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:10 devstack sudo[113703]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-18a27972-e96b-4626-8828-95430f9712b3 tempest-VolumeDependencyTests-1141527902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1145362f-b890-4382-ac22-986e757067e2 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897" returned: 0 in 0.310s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:10 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-18a27972-e96b-4626-8828-95430f9712b3 tempest-VolumeDependencyTests-1141527902 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897 is being set with open permissions: ugo+rw
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-18a27972-e96b-4626-8828-95430f9712b3 tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:10 devstack sudo[113709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897
Aug 12 16:38:10 devstack sudo[113709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:10 devstack sudo[113711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:10 devstack sudo[113711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:11 devstack sudo[113709]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-18a27972-e96b-4626-8828-95430f9712b3 tempest-VolumeDependencyTests-1141527902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897" returned: 0 in 0.272s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-18a27972-e96b-4626-8828-95430f9712b3 tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:11 devstack sudo[113711]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "cinder-408b3966-6eeb-462d-aef9-4155ec359b84-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.272s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:11 devstack sudo[113715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.info
Aug 12 16:38:11 devstack sudo[113715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:11 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] Deleted volume successfully.
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-408b3966-6eeb-462d-aef9-4155ec359b84-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-982b3c99-5368-4dce-a4f6-f52cb2d9c355 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-1832a6db-8505-4cc8-829f-011209f2a392-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "cinder-quobyte-408b3966-6eeb-462d-aef9-4155ec359b84" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-quobyte-408b3966-6eeb-462d-aef9-4155ec359b84" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a48274b-9903-4edc-a484-ea31003639d6]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-408b3966-6eeb-462d-aef9-4155ec359b84 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:11 devstack sudo[113717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-408b3966-6eeb-462d-aef9-4155ec359b84
Aug 12 16:38:11 devstack sudo[113717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:11 devstack sudo[113715]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-18a27972-e96b-4626-8828-95430f9712b3 tempest-VolumeDependencyTests-1141527902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.info" returned: 0 in 0.289s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:11 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-18a27972-e96b-4626-8828-95430f9712b3 tempest-VolumeDependencyTests-1141527902 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.info is being set with open permissions: ugo+rw
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-18a27972-e96b-4626-8828-95430f9712b3 tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:11 devstack sudo[113720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.info
Aug 12 16:38:11 devstack sudo[113720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:11 devstack sudo[113717]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-408b3966-6eeb-462d-aef9-4155ec359b84" returned: 0 in 0.367s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-408b3966-6eeb-462d-aef9-4155ec359b84 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:11 devstack sudo[113726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-408b3966-6eeb-462d-aef9-4155ec359b84
Aug 12 16:38:11 devstack sudo[113726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:11 devstack sudo[113720]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-18a27972-e96b-4626-8828-95430f9712b3 tempest-VolumeDependencyTests-1141527902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.info" returned: 0 in 0.252s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-18a27972-e96b-4626-8828-95430f9712b3 tempest-VolumeDependencyTests-1141527902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.055s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.788s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a22601dd-ed04-4fbd-a257-6b925e91da9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2c9c76dcccf4564a9efef4dd6a01a7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:06Z,use_quota=True,user_id='0cb99f4a8d374272a8c058f766e70745',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Creating volume a22601dd-ed04-4fbd-a257-6b925e91da9d {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:11 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a22601dd-ed04-4fbd-a257-6b925e91da9d 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:11 devstack sudo[113728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a22601dd-ed04-4fbd-a257-6b925e91da9d 1073741824
Aug 12 16:38:11 devstack sudo[113728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:11 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-18a27972-e96b-4626-8828-95430f9712b3 tempest-VolumeDependencyTests-1141527902 None] Create snapshot completed successfully
Aug 12 16:38:11 devstack sudo[113726]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-408b3966-6eeb-462d-aef9-4155ec359b84" returned: 0 in 0.267s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-quobyte-408b3966-6eeb-462d-aef9-4155ec359b84" released by "delete_volume" :: held 0.688s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:11 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] Created reservations ['6fb69b23-d42b-4fd5-ac15-1319114e6b20', '537ea0ac-bfb9-40cf-a2ed-a34864b37476', 'eaf4c5e3-6370-4460-a9db-5e0d6660585f', '42faf41c-524c-4e9c-9fdf-8f6c0cfb1d18'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:12 devstack sudo[113735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:12 devstack sudo[113735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:12 devstack sudo[113728]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a22601dd-ed04-4fbd-a257-6b925e91da9d 1073741824" returned: 0 in 0.496s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a22601dd-ed04-4fbd-a257-6b925e91da9d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:12 devstack sudo[113737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a22601dd-ed04-4fbd-a257-6b925e91da9d
Aug 12 16:38:12 devstack sudo[113737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:12 devstack sudo[113735]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.288s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:12 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] Deleted volume successfully.
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "cinder-3c3c219b-8d23-493a-be83-838759e00ea6-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-3c3c219b-8d23-493a-be83-838759e00ea6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0da246a4-4fcc-4ef5-8b32-7e961b29d51f tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-408b3966-6eeb-462d-aef9-4155ec359b84-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "cinder-quobyte-3c3c219b-8d23-493a-be83-838759e00ea6" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-quobyte-3c3c219b-8d23-493a-be83-838759e00ea6" acquired by "delete_volume" :: waited 0.022s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4c9663-af6f-408c-bd4c-a6c4c2441b65]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3c3c219b-8d23-493a-be83-838759e00ea6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:12 devstack sudo[113737]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a22601dd-ed04-4fbd-a257-6b925e91da9d" returned: 0 in 0.322s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.748s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adee8da0-ab9b-4646-b097-0fe596106413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33ac2ededee944d39fa320943f091b45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:08Z,use_quota=True,user_id='96c9830a8c4b4c4397c78a0eb38ead0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89f08076-fefe-4733-99a4-704b99a429f2),volume_type_id=89f08076-fefe-4733-99a4-704b99a429f2)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Creating volume adee8da0-ab9b-4646-b097-0fe596106413 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:12 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-adee8da0-ab9b-4646-b097-0fe596106413 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:12 devstack sudo[113742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-adee8da0-ab9b-4646-b097-0fe596106413 1073741824
Aug 12 16:38:12 devstack sudo[113742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Attempting download of 2dad45bb-73b3-409c-9989-03c6b404f7f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2dad45bb-73b3-409c-9989-03c6b404f7f6', 'metadata': {}}])) to volume a22601dd-ed04-4fbd-a257-6b925e91da9d. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 12 16:38:12 devstack sudo[113741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3c3c219b-8d23-493a-be83-838759e00ea6
Aug 12 16:38:12 devstack sudo[113741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3b390b-0911-4139-a4b9-b72ecc970661]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2dad45bb-73b3-409c-9989-03c6b404f7f6_9e20uc10 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Flow 'volume_create_manager' (f2f17140-3e03-45e0-b576-65bf23638190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712ecad3-4bc2-4783-b09d-e3f1847dd2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (712ecad3-4bc2-4783-b09d-e3f1847dd2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-65021703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=593a488b-40fd-438b-a9af-71db0d8b8704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd39b71438f54c85b45d5c0ba3608d8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6ca86716-e5a3-42ce-a184-0f23b3e6b897,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:13Z,use_quota=True,user_id='b4f28ce856d0458b953bf4cc71ba4ce8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ca1138-99eb-4514-b734-f3c1e2874d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ca1138-99eb-4514-b734-f3c1e2874d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c8cd2b-4505-4827-98f5-6879a464f842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0c8cd2b-4505-4827-98f5-6879a464f842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '593a488b-40fd-438b-a9af-71db0d8b8704', 'volume_name': 'volume-593a488b-40fd-438b-a9af-71db0d8b8704', 'volume_size': 1, 'snapshot_id': '6ca86716-e5a3-42ce-a184-0f23b3e6b897'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e394bb03-ec3e-4f3b-be42-e9434a4da5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e394bb03-ec3e-4f3b-be42-e9434a4da5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b779b62-d223-49ed-81da-272caf2a6427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:12 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Volume 593a488b-40fd-438b-a9af-71db0d8b8704: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-593a488b-40fd-438b-a9af-71db0d8b8704', 'volume_size': 1, 'snapshot_id': '6ca86716-e5a3-42ce-a184-0f23b3e6b897'}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:12 devstack sudo[113745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2dad45bb-73b3-409c-9989-03c6b404f7f6_9e20uc10
Aug 12 16:38:12 devstack sudo[113745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:12 devstack sudo[113741]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3c3c219b-8d23-493a-be83-838759e00ea6" returned: 0 in 0.466s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3c3c219b-8d23-493a-be83-838759e00ea6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:12 devstack sudo[113754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3c3c219b-8d23-493a-be83-838759e00ea6
Aug 12 16:38:13 devstack sudo[113754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:13 devstack sudo[113745]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2dad45bb-73b3-409c-9989-03c6b404f7f6_9e20uc10" returned: 0 in 0.397s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2dad45bb-73b3-409c-9989-03c6b404f7f6_9e20uc10 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:13 devstack sudo[113742]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-adee8da0-ab9b-4646-b097-0fe596106413 1073741824" returned: 0 in 0.528s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-adee8da0-ab9b-4646-b097-0fe596106413 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:13 devstack sudo[113759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-adee8da0-ab9b-4646-b097-0fe596106413
Aug 12 16:38:13 devstack sudo[113759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:13 devstack sudo[113758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2dad45bb-73b3-409c-9989-03c6b404f7f6_9e20uc10
Aug 12 16:38:13 devstack sudo[113758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:13 devstack sudo[113754]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3c3c219b-8d23-493a-be83-838759e00ea6" returned: 0 in 0.280s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-quobyte-3c3c219b-8d23-493a-be83-838759e00ea6" released by "delete_volume" :: held 0.791s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] Created reservations ['fa549559-e04e-4901-8f74-928fb54b3e15', 'eb42a131-07f3-4b20-9311-25f525188c0f', 'c1000b70-432a-472a-b3c8-73f8d1016e94', '30f4ca58-dec2-4cfe-bd8c-022da7d51bfb'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:13 devstack sudo[113759]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-adee8da0-ab9b-4646-b097-0fe596106413" returned: 0 in 0.284s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.620s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Acquiring lock "cinder-quobyte-6ca86716-e5a3-42ce-a184-0f23b3e6b897-593a488b-40fd-438b-a9af-71db0d8b8704" by "_create_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:13 devstack sudo[113765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:13 devstack sudo[113765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:13 devstack sudo[113758]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2dad45bb-73b3-409c-9989-03c6b404f7f6_9e20uc10" returned: 1 in 0.376s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2dad45bb-73b3-409c-9989-03c6b404f7f6_9e20uc10' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Lock "cinder-quobyte-6ca86716-e5a3-42ce-a184-0f23b3e6b897-593a488b-40fd-438b-a9af-71db0d8b8704" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Creating volume 593a488b-40fd-438b-a9af-71db0d8b8704 from snapshot 6ca86716-e5a3-42ce-a184-0f23b3e6b897 {{(pid=94457) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Acquiring lock "cinder-quobyte-593a488b-40fd-438b-a9af-71db0d8b8704" by "_copy_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[330efa86-a94a-4c0d-901b-aed558b62d5b]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Attempting download of 46edea08-6234-4146-b548-7fba8ee99636 ((None, [{'url': 'file:///opt/stack/data/glance/images/46edea08-6234-4146-b548-7fba8ee99636', 'metadata': {}}])) to volume adee8da0-ab9b-4646-b097-0fe596106413. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Lock "cinder-quobyte-593a488b-40fd-438b-a9af-71db0d8b8704" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] snapshot: 6ca86716-e5a3-42ce-a184-0f23b3e6b897, volume: 593a488b-40fd-438b-a9af-71db0d8b8704,  {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "cinder-7ce13bed-7dbc-4725-8402-3b164e1bc932-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d179fe2f-759c-4b0d-83e0-3b42615fdaa0]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3ba564-d018-48c7-92fc-3c94df86d9b4]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46edea08-6234-4146-b548-7fba8ee99636_zlzje6ej {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-7ce13bed-7dbc-4725-8402-3b164e1bc932-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:13 devstack sudo[113768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD
Aug 12 16:38:13 devstack sudo[113768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "cinder-quobyte-7ce13bed-7dbc-4725-8402-3b164e1bc932" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:13 devstack sudo[113769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897
Aug 12 16:38:13 devstack sudo[113769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-quobyte-7ce13bed-7dbc-4725-8402-3b164e1bc932" acquired by "delete_volume" :: waited 0.019s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e628f2-eae8-4380-9c1f-2f5720a87c40]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7ce13bed-7dbc-4725-8402-3b164e1bc932 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:13 devstack sudo[113770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46edea08-6234-4146-b548-7fba8ee99636_zlzje6ej
Aug 12 16:38:13 devstack sudo[113770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:13 devstack sudo[113765]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.444s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:13 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] Deleted volume successfully.
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-83eb334b-da75-4cd4-955f-064a35a7cff1 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-3c3c219b-8d23-493a-be83-838759e00ea6-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:13 devstack sudo[113774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7ce13bed-7dbc-4725-8402-3b164e1bc932
Aug 12 16:38:13 devstack sudo[113774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:13 devstack sudo[113768]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD" returned: 0 in 0.477s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:14 devstack sudo[113769]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:14 devstack sudo[113779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD
Aug 12 16:38:14 devstack sudo[113779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897" returned: 0 in 0.497s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1145362f-b890-4382-ac22-986e757067e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec14987b-91dd-4216-bb71-9ee42bfa47ea]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:14 devstack sudo[113770]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_46edea08-6234-4146-b548-7fba8ee99636_zlzje6ej" returned: 0 in 0.499s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46edea08-6234-4146-b548-7fba8ee99636_zlzje6ej {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:14 devstack sudo[113774]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7ce13bed-7dbc-4725-8402-3b164e1bc932" returned: 0 in 0.422s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7ce13bed-7dbc-4725-8402-3b164e1bc932 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:14 devstack sudo[113791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7ce13bed-7dbc-4725-8402-3b164e1bc932
Aug 12 16:38:14 devstack sudo[113791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:14 devstack sudo[113788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2
Aug 12 16:38:14 devstack sudo[113788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:14 devstack sudo[113790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46edea08-6234-4146-b548-7fba8ee99636_zlzje6ej
Aug 12 16:38:14 devstack sudo[113790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:14 devstack sudo[113779]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] 2dad45bb-73b3-409c-9989-03c6b404f7f6 was raw, converting to qcow2 {{(pid=94457) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a22601dd-ed04-4fbd-a257-6b925e91da9d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:14 devstack sudo[113798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a22601dd-ed04-4fbd-a257-6b925e91da9d
Aug 12 16:38:14 devstack sudo[113798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:14 devstack sudo[113791]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-7ce13bed-7dbc-4725-8402-3b164e1bc932" returned: 0 in 0.278s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-quobyte-7ce13bed-7dbc-4725-8402-3b164e1bc932" released by "delete_volume" :: held 0.749s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:14 devstack sudo[113790]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] Created reservations ['274564d4-a624-4016-ad6c-054f7e509b0d', '46508e10-f8e9-44ce-95f7-5da0c95334b3', '07d687b0-2ea6-4058-9f99-4d481e054b04', '1d9343f1-e223-40d3-aca0-c80f8c8c2722'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46edea08-6234-4146-b548-7fba8ee99636_zlzje6ej" returned: 1 in 0.397s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_46edea08-6234-4146-b548-7fba8ee99636_zlzje6ej' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c0e8b5-bf22-4ee8-9fcb-ee0c65835811]: (4, 'raw') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:14 devstack sudo[113788]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2" returned: 0 in 0.463s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2 {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Creating direct copy from snapshot {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG cinder.utils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Path /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593a488b-40fd-438b-a9af-71db0d8b8704 not found in is_blk_device check {{(pid=94457) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593a488b-40fd-438b-a9af-71db0d8b8704 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:14 devstack sudo[113808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593a488b-40fd-438b-a9af-71db0d8b8704
Aug 12 16:38:14 devstack sudo[113808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:14 devstack sudo[113812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:14 devstack sudo[113812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:14 devstack sudo[113807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD
Aug 12 16:38:14 devstack sudo[113807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "cinder-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "cinder-quobyte-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-quobyte-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af89490-f991-4054-8c85-c49bbde89068]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:14 devstack sudo[113798]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a22601dd-ed04-4fbd-a257-6b925e91da9d" returned: 0 in 0.675s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:14 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2dad45bb-73b3-409c-9989-03c6b404f7f6_hpnjtjjndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a22601dd-ed04-4fbd-a257-6b925e91da9d {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:38:14 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Converted 0.00 MB image at 0.00 MB/s
Aug 12 16:38:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a22601dd-ed04-4fbd-a257-6b925e91da9d 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:15 devstack sudo[113812]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.392s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:15 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:15 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] Deleted volume successfully.
Aug 12 16:38:15 devstack sudo[113822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a22601dd-ed04-4fbd-a257-6b925e91da9d 1G
Aug 12 16:38:15 devstack sudo[113822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:15 devstack sudo[113820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb
Aug 12 16:38:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ec08f5c1-07c9-43c1-b26d-dfb76f1fad2d tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-7ce13bed-7dbc-4725-8402-3b164e1bc932-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:15 devstack sudo[113820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:15 devstack sudo[113807]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD" returned: 0 in 0.618s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:15 devstack sudo[113830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD
Aug 12 16:38:15 devstack sudo[113830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:15 devstack sudo[113822]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a22601dd-ed04-4fbd-a257-6b925e91da9d 1G" returned: 0 in 0.823s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:15 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Downloaded image 2dad45bb-73b3-409c-9989-03c6b404f7f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/2dad45bb-73b3-409c-9989-03c6b404f7f6', 'metadata': {}}])) to volume a22601dd-ed04-4fbd-a257-6b925e91da9d successfully. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 12 16:38:15 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Temporary image 2dad45bb-73b3-409c-9989-03c6b404f7f6 for user 0cb99f4a8d374272a8c058f766e70745 is deleted. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 12 16:38:15 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Marking volume a22601dd-ed04-4fbd-a257-6b925e91da9d as bootable. {{(pid=94457) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 12 16:38:15 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Copying metadata from image 2dad45bb-73b3-409c-9989-03c6b404f7f6 to a22601dd-ed04-4fbd-a257-6b925e91da9d. {{(pid=94457) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 12 16:38:15 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Creating volume glance metadata for volume a22601dd-ed04-4fbd-a257-6b925e91da9d backed by image 2dad45bb-73b3-409c-9989-03c6b404f7f6 with: {'image_id': '2dad45bb-73b3-409c-9989-03c6b404f7f6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '84293846277f6d5328e0486cb41ef6c3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94457) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 12 16:38:16 devstack sudo[113820]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb" returned: 0 in 1.222s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:16 devstack sudo[113843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb
Aug 12 16:38:16 devstack sudo[113843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7394eeab-c812-45a4-b60e-add4a6f4f482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a22601dd-ed04-4fbd-a257-6b925e91da9d', 'volume_size': 1, 'image_id': '2dad45bb-73b3-409c-9989-03c6b404f7f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2dad45bb-73b3-409c-9989-03c6b404f7f6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '84293846277f6d5328e0486cb41ef6c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a2c9c76dcccf4564a9efef4dd6a01a7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1643106f4b8a813a3b6716f4daaa8978cfb8d8fb9ebc9a098ce54e5d94af6a5065dd46b0dbc83669e21117a9384f09741268515dec4f06fec3c57b8ef71c8bf3', 'id': '2dad45bb-73b3-409c-9989-03c6b404f7f6', 'created_at': datetime.datetime(2026, 8, 12, 14, 38, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 38, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2dad45bb-73b3-409c-9989-03c6b404f7f6/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b633b1d90>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077a513e-2230-4c46-9c9d-e2803b41c75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:16 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Volume volume-a22601dd-ed04-4fbd-a257-6b925e91da9d (a22601dd-ed04-4fbd-a257-6b925e91da9d): created successfully
Aug 12 16:38:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (077a513e-2230-4c46-9c9d-e2803b41c75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:16 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Flow 'volume_create_manager' (950f0ee4-db20-45b4-a162-1fb8277bb942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:16 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-00d83711-acd3-4705-b322-da316e348166 tempest-VolumeImageDependencyTests-245974035 None] Created volume successfully.
Aug 12 16:38:16 devstack sudo[113830]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD" returned: 1 in 1.194s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD' failed. Not Retrying. {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Aug 12 16:38:16 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] 46edea08-6234-4146-b548-7fba8ee99636 was raw, converting to qcow2 {{(pid=94457) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Aug 12 16:38:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-adee8da0-ab9b-4646-b097-0fe596106413 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:16 devstack sudo[113848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-adee8da0-ab9b-4646-b097-0fe596106413
Aug 12 16:38:16 devstack sudo[113848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:16 devstack sudo[113843]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb" returned: 0 in 0.643s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-quobyte-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb" released by "delete_volume" :: held 1.944s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:17 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] Created reservations ['3b13e32c-3f58-498d-80d4-3560a833791a', 'dadadeb2-37a5-4075-9507-279f52cb2cb5', 'd2df67ec-4617-491b-af83-9dd515b17b61', '268cfb7a-abd0-4c32-b285-6dd0b4142814'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:17 devstack sudo[113855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:17 devstack sudo[113855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:17 devstack sudo[113848]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-adee8da0-ab9b-4646-b097-0fe596106413" returned: 0 in 1.206s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:17 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_46edea08-6234-4146-b548-7fba8ee99636_3fati6gudevstack@QuobyteHD, size 0.00 MB, duration 1.21 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-adee8da0-ab9b-4646-b097-0fe596106413 {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:38:17 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Converted 0.00 MB image at 0.00 MB/s
Aug 12 16:38:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-adee8da0-ab9b-4646-b097-0fe596106413 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:17 devstack sudo[113857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-adee8da0-ab9b-4646-b097-0fe596106413 1G
Aug 12 16:38:17 devstack sudo[113857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] Acquiring lock "cinder-a22601dd-ed04-4fbd-a257-6b925e91da9d-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:17 devstack sudo[113855]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] Lock "cinder-a22601dd-ed04-4fbd-a257-6b925e91da9d-delete_volume" acquired by "delete_volume" :: waited 0.154s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.837s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:18 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:18 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] Deleted volume successfully.
Aug 12 16:38:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-39926518-2992-408e-9de0-c7e4e797ae72 tempest-CreateVolumesFromImageTest-1985922618 None] Lock "cinder-b2f959f4-c13a-4ed6-8267-e3e5399e1ccb-delete_volume" released by "delete_volume" :: held 3.342s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] Acquiring lock "cinder-quobyte-a22601dd-ed04-4fbd-a257-6b925e91da9d" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] Lock "cinder-quobyte-a22601dd-ed04-4fbd-a257-6b925e91da9d" acquired by "delete_volume" :: waited 0.052s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:18 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df77932-bb09-4ba0-8079-93ac286dec69]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a22601dd-ed04-4fbd-a257-6b925e91da9d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:18 devstack sudo[113857]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-adee8da0-ab9b-4646-b097-0fe596106413 1G" returned: 0 in 1.011s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:18 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Downloaded image 46edea08-6234-4146-b548-7fba8ee99636 ((None, [{'url': 'file:///opt/stack/data/glance/images/46edea08-6234-4146-b548-7fba8ee99636', 'metadata': {}}])) to volume adee8da0-ab9b-4646-b097-0fe596106413 successfully. {{(pid=94457) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Aug 12 16:38:18 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Temporary image 46edea08-6234-4146-b548-7fba8ee99636 for user 96c9830a8c4b4c4397c78a0eb38ead0f is deleted. {{(pid=94457) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Aug 12 16:38:18 devstack cinder-volume[94457]: DEBUG cinder.volume.volume_utils [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Marking volume adee8da0-ab9b-4646-b097-0fe596106413 as bootable. {{(pid=94457) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Aug 12 16:38:18 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Copying metadata from image 46edea08-6234-4146-b548-7fba8ee99636 to adee8da0-ab9b-4646-b097-0fe596106413. {{(pid=94457) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Aug 12 16:38:18 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Creating volume glance metadata for volume adee8da0-ab9b-4646-b097-0fe596106413 backed by image 46edea08-6234-4146-b548-7fba8ee99636 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '46edea08-6234-4146-b548-7fba8ee99636', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'adb3d748e1d732d2c064dcce4a87dfec', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=94457) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Aug 12 16:38:18 devstack sudo[113863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a22601dd-ed04-4fbd-a257-6b925e91da9d
Aug 12 16:38:18 devstack sudo[113863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (336d034e-e6f3-4a50-9a8b-1ae56fb3b049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adee8da0-ab9b-4646-b097-0fe596106413', 'volume_size': 1, 'image_id': '46edea08-6234-4146-b548-7fba8ee99636', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/46edea08-6234-4146-b548-7fba8ee99636', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'adb3d748e1d732d2c064dcce4a87dfec', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '33ac2ededee944d39fa320943f091b45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3f30e92fd9863493148290058730b3be413466132a6bcbe5d812387ab623f6ed99725c769d6b9f5c35b13be89afd834d8c2a292b6c48304375c292e3a792220e', 'id': '46edea08-6234-4146-b548-7fba8ee99636', 'created_at': datetime.datetime(2026, 8, 12, 14, 38, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 12, 14, 38, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/46edea08-6234-4146-b548-7fba8ee99636/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7a5b63660cb0>}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5c9dec-b866-4274-a692-08260c8d8ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:18 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Volume volume-adee8da0-ab9b-4646-b097-0fe596106413 (adee8da0-ab9b-4646-b097-0fe596106413): created successfully
Aug 12 16:38:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5c9dec-b866-4274-a692-08260c8d8ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Flow 'volume_create_manager' (cbaab1fd-a2c7-4846-ba7b-38724a047d57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:18 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-8f7069dc-33ee-4ae2-bd07-f6b30408dbe0 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Created volume successfully.
Aug 12 16:38:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:38:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:19 devstack sudo[113863]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a22601dd-ed04-4fbd-a257-6b925e91da9d" returned: 0 in 1.202s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:19 devstack sudo[113869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a22601dd-ed04-4fbd-a257-6b925e91da9d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:19 devstack sudo[113869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:19 devstack sudo[113871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a22601dd-ed04-4fbd-a257-6b925e91da9d
Aug 12 16:38:19 devstack sudo[113871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:20 devstack sudo[113869]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.654s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 29 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>, <Thread(Rabbit-heartbeat, started daemon 134532925736384)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Acquiring lock "cinder-adee8da0-ab9b-4646-b097-0fe596106413-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Lock "cinder-adee8da0-ab9b-4646-b097-0fe596106413-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Acquiring lock "cinder-quobyte-adee8da0-ab9b-4646-b097-0fe596106413" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Lock "cinder-quobyte-adee8da0-ab9b-4646-b097-0fe596106413" acquired by "delete_volume" :: waited 0.053s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:20 devstack sudo[113871]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a22601dd-ed04-4fbd-a257-6b925e91da9d" returned: 0 in 0.852s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] Lock "cinder-quobyte-a22601dd-ed04-4fbd-a257-6b925e91da9d" released by "delete_volume" :: held 2.186s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf08110-9018-4e9f-b79b-94bf069f8d93]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-adee8da0-ab9b-4646-b097-0fe596106413 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] Created reservations ['590c958f-811e-4749-b1fb-c590a19c648e', 'e0b76ea6-04ae-45f6-9d0e-6fe086c43ff5', '4e1ac276-ed39-4ee5-bdd8-058097c3e7b3', 'ea88fcdc-8ff0-4437-b93e-254aefc42bfc'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:20 devstack sudo[113808]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593a488b-40fd-438b-a9af-71db0d8b8704" returned: 0 in 6.140s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593a488b-40fd-438b-a9af-71db0d8b8704 {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:38:20 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Converted 1024.00 MB image at 166.71 MB/s
Aug 12 16:38:20 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593a488b-40fd-438b-a9af-71db0d8b8704 is being set with open permissions: ugo+rw
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593a488b-40fd-438b-a9af-71db0d8b8704 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:20 devstack sudo[113877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:20 devstack sudo[113877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:20 devstack sudo[113878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593a488b-40fd-438b-a9af-71db0d8b8704
Aug 12 16:38:20 devstack sudo[113878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:20 devstack sudo[113876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-adee8da0-ab9b-4646-b097-0fe596106413
Aug 12 16:38:20 devstack sudo[113876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:20 devstack sudo[113877]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.300s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:20 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:20 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] Deleted volume successfully.
Aug 12 16:38:20 devstack sudo[113878]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593a488b-40fd-438b-a9af-71db0d8b8704" returned: 0 in 0.300s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6ee1f0c8-6860-4997-bdc5-4f2c326fdd54 tempest-VolumeImageDependencyTests-245974035 None] Lock "cinder-a22601dd-ed04-4fbd-a257-6b925e91da9d-delete_volume" released by "delete_volume" :: held 3.035s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Lock "cinder-quobyte-593a488b-40fd-438b-a9af-71db0d8b8704" released by "_copy_volume_from_snapshot" :: held 7.532s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Lock "cinder-quobyte-6ca86716-e5a3-42ce-a184-0f23b3e6b897-593a488b-40fd-438b-a9af-71db0d8b8704" released by "_create_volume_from_snapshot" :: held 7.647s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.689s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b779b62-d223-49ed-81da-272caf2a6427) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-593a488b-40fd-438b-a9af-71db0d8b8704', 'volume_size': 1, 'snapshot_id': '6ca86716-e5a3-42ce-a184-0f23b3e6b897'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:21 devstack sudo[113876]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df8c078-763e-4eaa-be89-37b1aba0738b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-adee8da0-ab9b-4646-b097-0fe596106413" returned: 0 in 0.641s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-adee8da0-ab9b-4646-b097-0fe596106413 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:21 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Volume volume-593a488b-40fd-438b-a9af-71db0d8b8704 (593a488b-40fd-438b-a9af-71db0d8b8704): created successfully
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6df8c078-763e-4eaa-be89-37b1aba0738b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:21 devstack sudo[113888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-adee8da0-ab9b-4646-b097-0fe596106413
Aug 12 16:38:21 devstack sudo[113888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Flow 'volume_create_manager' (f2f17140-3e03-45e0-b576-65bf23638190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:21 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a2d1e456-4ed6-45a2-b09e-31752d2b1302 tempest-VolumeDependencyTests-1141527902 None] Created volume successfully.
Aug 12 16:38:21 devstack sudo[113888]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-adee8da0-ab9b-4646-b097-0fe596106413" returned: 0 in 0.268s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Lock "cinder-quobyte-adee8da0-ab9b-4646-b097-0fe596106413" released by "delete_volume" :: held 1.033s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Created reservations ['494d55aa-2cae-4dc5-a9e7-29425d6e0933', '4b5387c0-ba37-42df-ab2a-5cfa2aeb7ef6', 'bc96fbd8-5b06-46b6-bc83-d1f9f517ad1f', '16a4d99e-7985-4ee9-94a5-0dde50d2a37f'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:21 devstack sudo[113891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:21 devstack sudo[113891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] Acquiring lock "cinder-6ca86716-e5a3-42ce-a184-0f23b3e6b897-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] Lock "cinder-6ca86716-e5a3-42ce-a184-0f23b3e6b897-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] Acquiring lock "cinder-quobyte-1145362f-b890-4382-ac22-986e757067e2" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] Lock "cinder-quobyte-1145362f-b890-4382-ac22-986e757067e2" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] Acquiring lock "cinder-quobyte-6ca86716-e5a3-42ce-a184-0f23b3e6b897" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] Lock "cinder-quobyte-6ca86716-e5a3-42ce-a184-0f23b3e6b897" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] Deleting offline snapshot 6ca86716-e5a3-42ce-a184-0f23b3e6b897 of volume 1145362f-b890-4382-ac22-986e757067e2 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] snapshot_file for this snap is: volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[059afcff-10f1-4be1-b865-5a7ae149e561]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:21 devstack sudo[113891]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.357s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:21 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Deleted volume successfully.
Aug 12 16:38:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e8dea23c-c196-4dda-a102-f2fd54dedab8 tempest-VolumeAndVolumeTypeFromImageTest-1277312826 None] Lock "cinder-adee8da0-ab9b-4646-b097-0fe596106413-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:21 devstack sudo[113893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897
Aug 12 16:38:21 devstack sudo[113893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:22 devstack sudo[113893]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897" returned: 0 in 0.396s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1145362f-b890-4382-ac22-986e757067e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:38:22 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8a5236-e858-4e01-a974-63511898c67e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:22 devstack sudo[113899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2
Aug 12 16:38:22 devstack sudo[113899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:23 devstack sudo[113899]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2" returned: 0 in 0.737s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:23 devstack sudo[113904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897
Aug 12 16:38:23 devstack sudo[113904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Flow 'volume_create_manager' (aa603737-3256-4086-ba18-0c4fe102367c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5082e0e-7d34-497f-a6b4-bdd4f2180a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5082e0e-7d34-497f-a6b4-bdd4f2180a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1789971376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c2d009-95ca-4696-8cff-f61b1faef5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1257e1f08d044054adead1c604fea538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:23Z,use_quota=True,user_id='db84d410c27a4bd38df2eddaef300693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6b410a-2d77-43b1-91f6-215cc521648b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6b410a-2d77-43b1-91f6-215cc521648b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7df093b-7688-47a7-85c7-d712866089dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7df093b-7688-47a7-85c7-d712866089dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9c2d009-95ca-4696-8cff-f61b1faef5c2', 'volume_name': 'volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e12a83-2ece-4d2c-af0c-a4ec020f7921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e12a83-2ece-4d2c-af0c-a4ec020f7921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c350c4-e7cf-4fe9-8468-66504db96cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:23 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Volume b9c2d009-95ca-4696-8cff-f61b1faef5c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2', 'volume_size': 1}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1789971376',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c2d009-95ca-4696-8cff-f61b1faef5c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1257e1f08d044054adead1c604fea538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:23Z,use_quota=True,user_id='db84d410c27a4bd38df2eddaef300693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Creating volume b9c2d009-95ca-4696-8cff-f61b1faef5c2 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:23 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:23 devstack sudo[113906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2 1073741824
Aug 12 16:38:23 devstack sudo[113906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:23 devstack sudo[113904]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897" returned: 0 in 0.457s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:23 devstack sudo[113914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897
Aug 12 16:38:23 devstack sudo[113914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:23 devstack sudo[113906]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2 1073741824" returned: 0 in 0.562s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:23 devstack sudo[113914]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2.6ca86716-e5a3-42ce-a184-0f23b3e6b897" returned: 0 in 0.331s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:23 devstack sudo[113919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2
Aug 12 16:38:23 devstack sudo[113919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] Lock "cinder-quobyte-6ca86716-e5a3-42ce-a184-0f23b3e6b897" released by "_delete_snapshot" :: held 2.080s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] Lock "cinder-quobyte-1145362f-b890-4382-ac22-986e757067e2" released by "delete_snapshot" :: held 2.113s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:23 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] Created reservations ['6c779bb5-8e32-498d-8cc6-93781ea4da7e', 'f0ec15e7-78c4-4304-9f4f-183ba1a3c17f', '14931744-2056-416d-92d5-6c736ac8e935', 'c14c1b60-272c-4418-83f2-7e5ce976f318'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:24 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] Delete snapshot completed successfully.
Aug 12 16:38:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c035ccae-9fa6-469e-b841-b01b17e52879 tempest-VolumeDependencyTests-1141527902 None] Lock "cinder-6ca86716-e5a3-42ce-a184-0f23b3e6b897-delete_snapshot" released by "delete_snapshot" :: held 2.329s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:24 devstack sudo[113919]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2" returned: 0 in 0.305s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45c350c4-e7cf-4fe9-8468-66504db96cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a6bc9fd-f51a-4d39-a7f3-b6943a65303b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:24 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Volume volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2 (b9c2d009-95ca-4696-8cff-f61b1faef5c2): created successfully
Aug 12 16:38:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a6bc9fd-f51a-4d39-a7f3-b6943a65303b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:24 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Flow 'volume_create_manager' (aa603737-3256-4086-ba18-0c4fe102367c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:24 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-044c087a-49c7-4e61-8b7e-57632f82ec63 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Created volume successfully.
Aug 12 16:38:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] Acquiring lock "cinder-1145362f-b890-4382-ac22-986e757067e2-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] Lock "cinder-1145362f-b890-4382-ac22-986e757067e2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:25 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] Acquiring lock "cinder-quobyte-1145362f-b890-4382-ac22-986e757067e2" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:25 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] Lock "cinder-quobyte-1145362f-b890-4382-ac22-986e757067e2" acquired by "delete_volume" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:25 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b39e5d-ff8d-461c-8356-68f43ce5691e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:25 devstack sudo[113922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2
Aug 12 16:38:25 devstack sudo[113922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-29218cea-d6dc-4b2e-b0b8-bb033167e1a4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-29218cea-d6dc-4b2e-b0b8-bb033167e1a4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-29218cea-d6dc-4b2e-b0b8-bb033167e1a4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Creating offline snapshot 9a688b46-c635-40a9-bae8-534747dc42bb of volume b9c2d009-95ca-4696-8cff-f61b1faef5c2 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:38:25 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d37c0ed-39d0-4e6f-a421-fd9dcdc1dc42]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-29218cea-d6dc-4b2e-b0b8-bb033167e1a4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:25 devstack sudo[113922]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2" returned: 0 in 0.527s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:25 devstack sudo[113924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2
Aug 12 16:38:25 devstack sudo[113924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:25 devstack sudo[113928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2
Aug 12 16:38:25 devstack sudo[113928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:25 devstack sudo[113928]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1145362f-b890-4382-ac22-986e757067e2" returned: 0 in 0.270s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:25 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] Lock "cinder-quobyte-1145362f-b890-4382-ac22-986e757067e2" released by "delete_volume" :: held 0.886s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:25 devstack sudo[113924]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-29218cea-d6dc-4b2e-b0b8-bb033167e1a4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2" returned: 0 in 0.429s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-29218cea-d6dc-4b2e-b0b8-bb033167e1a4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:25 devstack sudo[113935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb 1G
Aug 12 16:38:25 devstack sudo[113935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] Created reservations ['9db1ef63-203c-44ea-a67d-ccc6ab7bb72a', '40627127-b763-43be-9d18-232c15ae1b36', '91c8dc9a-06ab-4b0f-bc16-1c426e376f2e', '230d020c-6668-46df-8cb3-58f76c18b93a'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:26 devstack sudo[113937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:26 devstack sudo[113937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] Acquiring lock "cinder-593a488b-40fd-438b-a9af-71db0d8b8704-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] Lock "cinder-593a488b-40fd-438b-a9af-71db0d8b8704-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] Acquiring lock "cinder-quobyte-593a488b-40fd-438b-a9af-71db0d8b8704" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] Lock "cinder-quobyte-593a488b-40fd-438b-a9af-71db0d8b8704" acquired by "delete_volume" :: waited 0.031s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d885ae75-edda-42e8-988f-b927d4d822ee]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593a488b-40fd-438b-a9af-71db0d8b8704 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:26 devstack sudo[113937]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.403s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:26 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] Deleted volume successfully.
Aug 12 16:38:26 devstack sudo[113942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593a488b-40fd-438b-a9af-71db0d8b8704
Aug 12 16:38:26 devstack sudo[113942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8f9cd707-4e34-464c-a60e-c97148939a07 tempest-VolumeDependencyTests-1141527902 None] Lock "cinder-1145362f-b890-4382-ac22-986e757067e2-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:26 devstack sudo[113935]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-29218cea-d6dc-4b2e-b0b8-bb033167e1a4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb 1G" returned: 0 in 0.657s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-29218cea-d6dc-4b2e-b0b8-bb033167e1a4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:26 devstack sudo[113946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb
Aug 12 16:38:26 devstack sudo[113946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:26 devstack sudo[113942]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593a488b-40fd-438b-a9af-71db0d8b8704" returned: 0 in 0.503s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593a488b-40fd-438b-a9af-71db0d8b8704 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:26 devstack sudo[113953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593a488b-40fd-438b-a9af-71db0d8b8704
Aug 12 16:38:26 devstack sudo[113953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:26 devstack sudo[113946]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-29218cea-d6dc-4b2e-b0b8-bb033167e1a4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb" returned: 0 in 0.377s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:26 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-29218cea-d6dc-4b2e-b0b8-bb033167e1a4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb is being set with open permissions: ugo+rw
Aug 12 16:38:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-29218cea-d6dc-4b2e-b0b8-bb033167e1a4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:27 devstack sudo[113957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb
Aug 12 16:38:27 devstack sudo[113957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:27 devstack sudo[113953]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-593a488b-40fd-438b-a9af-71db0d8b8704" returned: 0 in 0.313s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:27 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] Lock "cinder-quobyte-593a488b-40fd-438b-a9af-71db0d8b8704" released by "delete_volume" :: held 0.881s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:27 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] Created reservations ['6f7fb81d-33ea-4b4c-8453-44f4d4f827f6', 'a39987e0-6d83-4fdc-9dd6-e96bb4d867fa', '0b648242-70a0-4736-abfa-0e11cea5031a', '9bc55167-3cca-4867-9c3a-782bfc3b5e64'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:27 devstack sudo[113957]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-29218cea-d6dc-4b2e-b0b8-bb033167e1a4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb" returned: 0 in 0.287s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-29218cea-d6dc-4b2e-b0b8-bb033167e1a4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:27 devstack sudo[113961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.info
Aug 12 16:38:27 devstack sudo[113961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:27 devstack sudo[113963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:27 devstack sudo[113963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:27 devstack sudo[113963]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.349s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:27 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:27 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] Deleted volume successfully.
Aug 12 16:38:27 devstack sudo[113961]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-29218cea-d6dc-4b2e-b0b8-bb033167e1a4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.info" returned: 0 in 0.472s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:27 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-29218cea-d6dc-4b2e-b0b8-bb033167e1a4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.info is being set with open permissions: ugo+rw
Aug 12 16:38:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-29218cea-d6dc-4b2e-b0b8-bb033167e1a4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:27 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3d8293d8-bd7d-4191-a3f7-8b729fa9861e tempest-VolumeDependencyTests-1141527902 None] Lock "cinder-593a488b-40fd-438b-a9af-71db0d8b8704-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:27 devstack sudo[113967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.info
Aug 12 16:38:27 devstack sudo[113967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:28 devstack sudo[113967]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-29218cea-d6dc-4b2e-b0b8-bb033167e1a4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.info" returned: 0 in 0.264s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-29218cea-d6dc-4b2e-b0b8-bb033167e1a4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.623s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:28 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-29218cea-d6dc-4b2e-b0b8-bb033167e1a4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Create snapshot completed successfully
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Flow 'volume_create_manager' (7e537fba-0d67-4f8a-b486-67d75bf7f050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a92e32-f398-4986-8475-24d0c0a4aa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3a92e32-f398-4986-8475-24d0c0a4aa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-20388781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1257e1f08d044054adead1c604fea538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:29Z,use_quota=True,user_id='db84d410c27a4bd38df2eddaef300693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20bfe395-da6b-4f0b-995a-e34c8ccb191e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20bfe395-da6b-4f0b-995a-e34c8ccb191e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821e1b07-1738-4112-9c49-376dc674f24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821e1b07-1738-4112-9c49-376dc674f24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d', 'volume_name': 'volume-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c520eb86-3cb6-441c-98f5-d967c57c1f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c520eb86-3cb6-441c-98f5-d967c57c1f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e4714b-0bdd-43da-8d8b-5ffc879168fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:29 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Volume 47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d', 'volume_size': 1}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-20388781',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1257e1f08d044054adead1c604fea538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:29Z,use_quota=True,user_id='db84d410c27a4bd38df2eddaef300693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Creating volume 47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:29 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:29 devstack sudo[113970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d 1073741824
Aug 12 16:38:29 devstack sudo[113970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:29 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4563deed-9ccb-4acf-ab2b-159d2c6aa833 tempest-ProjectAdminTests-793133059 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=94457) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Flow 'volume_create_manager' (fe6437b6-bf0b-4924-8a46-aefa32bb6c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba780bf6-6763-4874-aed0-a33cbc0dc2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:30 devstack sudo[113970]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba780bf6-6763-4874-aed0-a33cbc0dc2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1942703620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d057aa79-7154-4dab-bc96-0a6769cfdd90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1257e1f08d044054adead1c604fea538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:30Z,use_quota=True,user_id='db84d410c27a4bd38df2eddaef300693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2decc789-fb2a-4e98-9d4c-d4775adc9cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2decc789-fb2a-4e98-9d4c-d4775adc9cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6873a41c-9ce2-4d50-80c2-9bb4fafc6f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6873a41c-9ce2-4d50-80c2-9bb4fafc6f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd057aa79-7154-4dab-bc96-0a6769cfdd90', 'volume_name': 'volume-d057aa79-7154-4dab-bc96-0a6769cfdd90', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55010fb-9eea-4cb1-ab79-efeb240b5997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d55010fb-9eea-4cb1-ab79-efeb240b5997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed21ce01-7f9e-4d9e-8f1e-22fe2f9f8b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:30 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Volume d057aa79-7154-4dab-bc96-0a6769cfdd90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d057aa79-7154-4dab-bc96-0a6769cfdd90', 'volume_size': 1}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d 1073741824" returned: 0 in 0.776s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:30 devstack sudo[114012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d
Aug 12 16:38:30 devstack sudo[114012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Flow 'volume_create_manager' (5625072e-0f61-4ec6-8fd1-53ce1fa6b230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:30 devstack sudo[114012]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fbc5351-2ab0-4b5d-bd48-7d3c88372ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d" returned: 0 in 0.396s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.454s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1942703620',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d057aa79-7154-4dab-bc96-0a6769cfdd90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1257e1f08d044054adead1c604fea538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:30Z,use_quota=True,user_id='db84d410c27a4bd38df2eddaef300693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Creating volume d057aa79-7154-4dab-bc96-0a6769cfdd90 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:30 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d057aa79-7154-4dab-bc96-0a6769cfdd90 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fbc5351-2ab0-4b5d-bd48-7d3c88372ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1108437120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a957bf02-fcdc-46e5-afa6-ee110fc1790f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1257e1f08d044054adead1c604fea538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:31Z,use_quota=True,user_id='db84d410c27a4bd38df2eddaef300693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1394d4cc-5cac-426e-abac-de9c1366dc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1394d4cc-5cac-426e-abac-de9c1366dc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3b4a5f-6489-4ead-86fa-d86dd8de4da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3b4a5f-6489-4ead-86fa-d86dd8de4da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a957bf02-fcdc-46e5-afa6-ee110fc1790f', 'volume_name': 'volume-a957bf02-fcdc-46e5-afa6-ee110fc1790f', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d235a3-1848-4460-b7dc-4b455f018cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d235a3-1848-4460-b7dc-4b455f018cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:30 devstack sudo[114015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d057aa79-7154-4dab-bc96-0a6769cfdd90 1073741824
Aug 12 16:38:30 devstack sudo[114015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90574162-8aad-4128-93ec-3d395d02f5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:30 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Volume a957bf02-fcdc-46e5-afa6-ee110fc1790f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a957bf02-fcdc-46e5-afa6-ee110fc1790f', 'volume_size': 1}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e4714b-0bdd-43da-8d8b-5ffc879168fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104d94a9-ee25-4a08-a4c4-4518efffa855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:30 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Volume volume-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d (47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d): created successfully
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104d94a9-ee25-4a08-a4c4-4518efffa855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:30 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Flow 'volume_create_manager' (7e537fba-0d67-4f8a-b486-67d75bf7f050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:30 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5799e02e-7fba-4fe8-981a-3b102ce8d46f tempest-CreateVolumesFromSnapshotTest-1713552165 None] Created volume successfully.
Aug 12 16:38:31 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Flow 'volume_create_manager' (90c5da28-acca-486a-918d-5122c4e24134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c28fc41-103c-4f5f-939c-52bcf096c40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c28fc41-103c-4f5f-939c-52bcf096c40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-996139916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acae59a5-93e3-4b69-b583-a098ef433b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1257e1f08d044054adead1c604fea538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:31Z,use_quota=True,user_id='db84d410c27a4bd38df2eddaef300693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c938ff20-2987-4a34-b8c6-61df49241545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c938ff20-2987-4a34-b8c6-61df49241545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1a5dc9-50f7-4d11-9009-91532f57f69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f1a5dc9-50f7-4d11-9009-91532f57f69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acae59a5-93e3-4b69-b583-a098ef433b05', 'volume_name': 'volume-acae59a5-93e3-4b69-b583-a098ef433b05', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50eb07a7-45bb-45e6-89ce-b638e4d73339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50eb07a7-45bb-45e6-89ce-b638e4d73339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:31 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8674beee-4419-4539-9677-5d6254a21a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:31 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Volume acae59a5-93e3-4b69-b583-a098ef433b05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acae59a5-93e3-4b69-b583-a098ef433b05', 'volume_size': 1}
Aug 12 16:38:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:31 devstack sudo[114015]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d057aa79-7154-4dab-bc96-0a6769cfdd90 1073741824" returned: 0 in 0.785s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d057aa79-7154-4dab-bc96-0a6769cfdd90 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:31 devstack sudo[114021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d057aa79-7154-4dab-bc96-0a6769cfdd90
Aug 12 16:38:31 devstack sudo[114021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:32 devstack sudo[114021]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Flow 'volume_create_manager' (5b664fe1-5fdd-473d-8e31-630bef470997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2883b45-f6c1-4eeb-8564-89222f27e3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d057aa79-7154-4dab-bc96-0a6769cfdd90" returned: 0 in 0.450s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.247s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1108437120',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a957bf02-fcdc-46e5-afa6-ee110fc1790f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1257e1f08d044054adead1c604fea538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:31Z,use_quota=True,user_id='db84d410c27a4bd38df2eddaef300693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Creating volume a957bf02-fcdc-46e5-afa6-ee110fc1790f {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:32 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a957bf02-fcdc-46e5-afa6-ee110fc1790f 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2883b45-f6c1-4eeb-8564-89222f27e3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1308704550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b0d48bd-2321-4581-b0ec-a53fe967c8e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1257e1f08d044054adead1c604fea538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:32Z,use_quota=True,user_id='db84d410c27a4bd38df2eddaef300693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:32 devstack sudo[114024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a957bf02-fcdc-46e5-afa6-ee110fc1790f 1073741824
Aug 12 16:38:32 devstack sudo[114024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd35d623-7858-461d-82c6-74929e2968c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd35d623-7858-461d-82c6-74929e2968c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (023461bc-c5b9-4a84-b7c8-8d482ca13df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (023461bc-c5b9-4a84-b7c8-8d482ca13df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b0d48bd-2321-4581-b0ec-a53fe967c8e6', 'volume_name': 'volume-9b0d48bd-2321-4581-b0ec-a53fe967c8e6', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558feda1-98a9-4a3a-970f-6b42e7e7f79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558feda1-98a9-4a3a-970f-6b42e7e7f79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a731ca-07d3-4883-a01f-e682021273db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:32 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Volume 9b0d48bd-2321-4581-b0ec-a53fe967c8e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b0d48bd-2321-4581-b0ec-a53fe967c8e6', 'volume_size': 1}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed21ce01-7f9e-4d9e-8f1e-22fe2f9f8b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d057aa79-7154-4dab-bc96-0a6769cfdd90', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523edbe2-b565-4880-9fe4-7a2d22e009a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:32 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Volume volume-d057aa79-7154-4dab-bc96-0a6769cfdd90 (d057aa79-7154-4dab-bc96-0a6769cfdd90): created successfully
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523edbe2-b565-4880-9fe4-7a2d22e009a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Flow 'volume_create_manager' (fe6437b6-bf0b-4924-8a46-aefa32bb6c2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:32 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-4acde54a-9867-455a-96d5-2b9727c44410 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Created volume successfully.
Aug 12 16:38:32 devstack sudo[114024]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a957bf02-fcdc-46e5-afa6-ee110fc1790f 1073741824" returned: 0 in 0.660s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a957bf02-fcdc-46e5-afa6-ee110fc1790f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:32 devstack sudo[114030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a957bf02-fcdc-46e5-afa6-ee110fc1790f
Aug 12 16:38:32 devstack sudo[114030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:33 devstack sudo[114030]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a957bf02-fcdc-46e5-afa6-ee110fc1790f" returned: 0 in 0.297s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.597s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-996139916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acae59a5-93e3-4b69-b583-a098ef433b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1257e1f08d044054adead1c604fea538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:31Z,use_quota=True,user_id='db84d410c27a4bd38df2eddaef300693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Creating volume acae59a5-93e3-4b69-b583-a098ef433b05 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:33 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-acae59a5-93e3-4b69-b583-a098ef433b05 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90574162-8aad-4128-93ec-3d395d02f5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a957bf02-fcdc-46e5-afa6-ee110fc1790f', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cfb28bc-d62b-4936-adf2-f611b9b4dc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:33 devstack sudo[114033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-acae59a5-93e3-4b69-b583-a098ef433b05 1073741824
Aug 12 16:38:33 devstack sudo[114033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:33 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Volume volume-a957bf02-fcdc-46e5-afa6-ee110fc1790f (a957bf02-fcdc-46e5-afa6-ee110fc1790f): created successfully
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cfb28bc-d62b-4936-adf2-f611b9b4dc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Flow 'volume_create_manager' (5625072e-0f61-4ec6-8fd1-53ce1fa6b230) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:33 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e2103d54-75ee-4900-8dfe-ccab3edca66e tempest-CreateVolumesFromSnapshotTest-1713552165 None] Created volume successfully.
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Flow 'volume_create_manager' (eb90ec4b-bc2e-4ee0-91e3-e61d6bbb58c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:33 devstack sudo[114033]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (630ae71c-0fe0-4f4a-965a-37b27672a334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-acae59a5-93e3-4b69-b583-a098ef433b05 1073741824" returned: 0 in 0.692s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (630ae71c-0fe0-4f4a-965a-37b27672a334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=696ee8cb-cb3a-43ee-b0d5-7f7cbb855495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f7b3764198d4051b3c6c2990f18524a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:34Z,use_quota=True,user_id='1feeef8d909847e0a421ae44bf7c1aba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d00426-4423-425e-84fb-af29870f3e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d00426-4423-425e-84fb-af29870f3e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fce2004-2f9e-43b4-9a24-a4d8967d174c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fce2004-2f9e-43b4-9a24-a4d8967d174c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '696ee8cb-cb3a-43ee-b0d5-7f7cbb855495', 'volume_name': 'volume-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87395008-c002-429f-8658-789858d94405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87395008-c002-429f-8658-789858d94405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7ddca9-48c6-44d3-9fb6-1cba9ca1b576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:33 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Volume 696ee8cb-cb3a-43ee-b0d5-7f7cbb855495: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495', 'volume_size': 1}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-acae59a5-93e3-4b69-b583-a098ef433b05 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:33 devstack sudo[114045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-acae59a5-93e3-4b69-b583-a098ef433b05
Aug 12 16:38:33 devstack sudo[114045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:34 devstack sudo[114045]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-acae59a5-93e3-4b69-b583-a098ef433b05" returned: 0 in 0.263s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.944s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1308704550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b0d48bd-2321-4581-b0ec-a53fe967c8e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1257e1f08d044054adead1c604fea538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:32Z,use_quota=True,user_id='db84d410c27a4bd38df2eddaef300693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Creating volume 9b0d48bd-2321-4581-b0ec-a53fe967c8e6 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:34 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b0d48bd-2321-4581-b0ec-a53fe967c8e6 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8674beee-4419-4539-9677-5d6254a21a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acae59a5-93e3-4b69-b583-a098ef433b05', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:34 devstack sudo[114048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b0d48bd-2321-4581-b0ec-a53fe967c8e6 1073741824
Aug 12 16:38:34 devstack sudo[114048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3de168-3343-4d91-a72a-9ff7b4b05d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:34 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Volume volume-acae59a5-93e3-4b69-b583-a098ef433b05 (acae59a5-93e3-4b69-b583-a098ef433b05): created successfully
Aug 12 16:38:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3de168-3343-4d91-a72a-9ff7b4b05d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:34 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Flow 'volume_create_manager' (90c5da28-acca-486a-918d-5122c4e24134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:34 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-68f5e74f-b8ad-411d-b15f-e6d6f29cb05c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Created volume successfully.
Aug 12 16:38:34 devstack sudo[114048]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b0d48bd-2321-4581-b0ec-a53fe967c8e6 1073741824" returned: 0 in 0.539s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b0d48bd-2321-4581-b0ec-a53fe967c8e6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:34 devstack sudo[114054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b0d48bd-2321-4581-b0ec-a53fe967c8e6
Aug 12 16:38:34 devstack sudo[114054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:35 devstack sudo[114054]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b0d48bd-2321-4581-b0ec-a53fe967c8e6" returned: 0 in 0.267s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.151s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=696ee8cb-cb3a-43ee-b0d5-7f7cbb855495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f7b3764198d4051b3c6c2990f18524a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:34Z,use_quota=True,user_id='1feeef8d909847e0a421ae44bf7c1aba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Creating volume 696ee8cb-cb3a-43ee-b0d5-7f7cbb855495 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:35 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5a731ca-07d3-4883-a01f-e682021273db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b0d48bd-2321-4581-b0ec-a53fe967c8e6', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:35 devstack sudo[114057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495 1073741824
Aug 12 16:38:35 devstack sudo[114057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c756ac-5d86-46a7-975c-90d0fa0a42d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:35 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Volume volume-9b0d48bd-2321-4581-b0ec-a53fe967c8e6 (9b0d48bd-2321-4581-b0ec-a53fe967c8e6): created successfully
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c756ac-5d86-46a7-975c-90d0fa0a42d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Flow 'volume_create_manager' (5b664fe1-5fdd-473d-8e31-630bef470997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:35 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-d7d1c3fd-5a4b-4698-a457-85fd086a093c tempest-CreateVolumesFromSnapshotTest-1713552165 None] Created volume successfully.
Aug 12 16:38:35 devstack sudo[114057]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495 1073741824" returned: 0 in 0.512s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "cinder-9b0d48bd-2321-4581-b0ec-a53fe967c8e6-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-9b0d48bd-2321-4581-b0ec-a53fe967c8e6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:35 devstack sudo[114063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495
Aug 12 16:38:35 devstack sudo[114063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "cinder-quobyte-9b0d48bd-2321-4581-b0ec-a53fe967c8e6" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-quobyte-9b0d48bd-2321-4581-b0ec-a53fe967c8e6" acquired by "delete_volume" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59a207c-b665-478f-9cc3-ae5562cf1b47]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b0d48bd-2321-4581-b0ec-a53fe967c8e6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:35 devstack sudo[114065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b0d48bd-2321-4581-b0ec-a53fe967c8e6
Aug 12 16:38:35 devstack sudo[114065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:35 devstack sudo[114063]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495" returned: 0 in 0.386s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7ddca9-48c6-44d3-9fb6-1cba9ca1b576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabf4e44-e2f2-457a-a1ea-d3745bc1894e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:36 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Volume volume-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495 (696ee8cb-cb3a-43ee-b0d5-7f7cbb855495): created successfully
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dabf4e44-e2f2-457a-a1ea-d3745bc1894e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Flow 'volume_create_manager' (eb90ec4b-bc2e-4ee0-91e3-e61d6bbb58c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:36 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-7adb9c63-b7a7-47a1-aa3c-1a49236afac9 tempest-CinderUnicodeTest-1339641332 None] Created volume successfully.
Aug 12 16:38:36 devstack sudo[114065]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b0d48bd-2321-4581-b0ec-a53fe967c8e6" returned: 0 in 0.458s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b0d48bd-2321-4581-b0ec-a53fe967c8e6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:36 devstack sudo[114071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b0d48bd-2321-4581-b0ec-a53fe967c8e6
Aug 12 16:38:36 devstack sudo[114071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:36 devstack sudo[114071]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-9b0d48bd-2321-4581-b0ec-a53fe967c8e6" returned: 0 in 0.289s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-quobyte-9b0d48bd-2321-4581-b0ec-a53fe967c8e6" released by "delete_volume" :: held 0.810s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Created reservations ['211352dc-c01a-4115-a1cb-362b668bce37', '78b6e3a7-d9f5-40d7-a49a-1c4442691f4c', 'ad6633f6-9567-4bed-bb1f-90873ff5afc4', '019a641b-aa8c-46d4-a098-3532b599cbbe'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:36 devstack sudo[114074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:36 devstack sudo[114074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "cinder-acae59a5-93e3-4b69-b583-a098ef433b05-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-acae59a5-93e3-4b69-b583-a098ef433b05-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "cinder-quobyte-acae59a5-93e3-4b69-b583-a098ef433b05" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-quobyte-acae59a5-93e3-4b69-b583-a098ef433b05" acquired by "delete_volume" :: waited 0.020s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:36 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f43d42-b145-407d-bc4c-c2f9483aeb00]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-acae59a5-93e3-4b69-b583-a098ef433b05 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:37 devstack sudo[114074]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.370s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:37 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Deleted volume successfully.
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-424c3b4c-c40a-4d10-a625-acfae4e193d5 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-9b0d48bd-2321-4581-b0ec-a53fe967c8e6-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:37 devstack sudo[114076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-acae59a5-93e3-4b69-b583-a098ef433b05
Aug 12 16:38:37 devstack sudo[114076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-acae59a5-93e3-4b69-b583-a098ef433b05" returned: 0 in 0.529s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-acae59a5-93e3-4b69-b583-a098ef433b05 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:37 devstack sudo[114076]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:37 devstack sudo[114082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-acae59a5-93e3-4b69-b583-a098ef433b05
Aug 12 16:38:37 devstack sudo[114082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Flow 'volume_create_manager' (fad82589-9548-484c-af8e-8afde9e3a8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e25394-a001-40ec-a899-b478f9480486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e25394-a001-40ec-a899-b478f9480486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1648658603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bed62f8-66e0-4ac9-a6c5-160eb552b57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f7b3764198d4051b3c6c2990f18524a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:38Z,use_quota=True,user_id='1feeef8d909847e0a421ae44bf7c1aba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ecdde7-efa3-4031-9b96-02541e82770f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ecdde7-efa3-4031-9b96-02541e82770f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2846f077-9bfd-4e10-9b32-0ae87cd778fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2846f077-9bfd-4e10-9b32-0ae87cd778fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bed62f8-66e0-4ac9-a6c5-160eb552b57b', 'volume_name': 'volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd919bca-4a58-4a3a-bd81-59d7341dd2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd919bca-4a58-4a3a-bd81-59d7341dd2c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264fe567-bc48-45f0-ba60-613d0140927e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:37 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Volume 6bed62f8-66e0-4ac9-a6c5-160eb552b57b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b', 'volume_size': 1}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1648658603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bed62f8-66e0-4ac9-a6c5-160eb552b57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f7b3764198d4051b3c6c2990f18524a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:38Z,use_quota=True,user_id='1feeef8d909847e0a421ae44bf7c1aba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Creating volume 6bed62f8-66e0-4ac9-a6c5-160eb552b57b {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:37 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:37 devstack sudo[114082]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-acae59a5-93e3-4b69-b583-a098ef433b05" returned: 0 in 0.291s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:37 devstack sudo[114085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b 1073741824
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-quobyte-acae59a5-93e3-4b69-b583-a098ef433b05" released by "delete_volume" :: held 0.885s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:37 devstack sudo[114085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Created reservations ['e7f04c75-4849-4f08-9c86-09fa609e208f', 'b088125e-73ba-47fb-aded-29ce0764998e', '640c3e87-bbf8-419f-8fb4-f3ed28ddebac', '5edf7f2a-4990-4f73-9faf-6dd1ed39ad2d'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:38 devstack sudo[114087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:38 devstack sudo[114087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "cinder-a957bf02-fcdc-46e5-afa6-ee110fc1790f-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-a957bf02-fcdc-46e5-afa6-ee110fc1790f-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "cinder-quobyte-a957bf02-fcdc-46e5-afa6-ee110fc1790f" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-quobyte-a957bf02-fcdc-46e5-afa6-ee110fc1790f" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[28271342-6d17-465c-8770-f02b7715a687]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a957bf02-fcdc-46e5-afa6-ee110fc1790f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:38 devstack sudo[114087]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.406s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:38 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Deleted volume successfully.
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-3c54ec5a-0a1a-44e4-8ed4-60316e62d2a0 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-acae59a5-93e3-4b69-b583-a098ef433b05-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:38 devstack sudo[114085]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b 1073741824" returned: 0 in 0.710s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:38 devstack sudo[114094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a957bf02-fcdc-46e5-afa6-ee110fc1790f
Aug 12 16:38:38 devstack sudo[114094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:38 devstack sudo[114096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b
Aug 12 16:38:38 devstack sudo[114096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:38 devstack sudo[114094]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a957bf02-fcdc-46e5-afa6-ee110fc1790f" returned: 0 in 0.498s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a957bf02-fcdc-46e5-afa6-ee110fc1790f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:38 devstack sudo[114096]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b" returned: 0 in 0.304s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (264fe567-bc48-45f0-ba60-613d0140927e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:38 devstack sudo[114102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a957bf02-fcdc-46e5-afa6-ee110fc1790f
Aug 12 16:38:38 devstack sudo[114102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c760e9-720a-4156-9dfb-3aebd1d2ceeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:38 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Volume volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b (6bed62f8-66e0-4ac9-a6c5-160eb552b57b): created successfully
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c760e9-720a-4156-9dfb-3aebd1d2ceeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:38 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Flow 'volume_create_manager' (fad82589-9548-484c-af8e-8afde9e3a8bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:38 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a2a8ce1c-919d-4381-a050-5059beec8984 tempest-CinderUnicodeTest-1339641332 None] Created volume successfully.
Aug 12 16:38:39 devstack sudo[114102]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a957bf02-fcdc-46e5-afa6-ee110fc1790f" returned: 0 in 0.303s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-quobyte-a957bf02-fcdc-46e5-afa6-ee110fc1790f" released by "delete_volume" :: held 0.860s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Created reservations ['67a2bdab-4075-4f0e-bbc4-d256104fa173', '8144b18f-81ab-482e-ae88-051576ec28cb', '9686dc2c-ab94-40fb-b4f2-deeff32b16b9', 'a4ef46cb-7515-4ad4-96b5-3edcb669e840'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:39 devstack sudo[114105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:39 devstack sudo[114105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "cinder-d057aa79-7154-4dab-bc96-0a6769cfdd90-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-d057aa79-7154-4dab-bc96-0a6769cfdd90-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "cinder-quobyte-d057aa79-7154-4dab-bc96-0a6769cfdd90" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-quobyte-d057aa79-7154-4dab-bc96-0a6769cfdd90" acquired by "delete_volume" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[527e5b4e-37a7-4ac5-96ce-198ebb410348]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d057aa79-7154-4dab-bc96-0a6769cfdd90 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Flow 'volume_create_manager' (3dc30243-cd52-4472-9c57-7fbeb2b5a94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c9ae89-455b-4f52-8d96-42ac5d164942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42c9ae89-455b-4f52-8d96-42ac5d164942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1475444966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b03f26-7336-4a78-950c-34cb432b0749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b7817e4d864eb8a8f2bdc76dd2045e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:40Z,use_quota=True,user_id='7fb20afd62b3490e9c81681bdd674e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848888ee-6606-4062-96af-fa062b1becd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (848888ee-6606-4062-96af-fa062b1becd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d80f6a-b25f-4e36-980b-b5eb6005b241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0d80f6a-b25f-4e36-980b-b5eb6005b241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24b03f26-7336-4a78-950c-34cb432b0749', 'volume_name': 'volume-24b03f26-7336-4a78-950c-34cb432b0749', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7ef339-3c55-452b-921d-8e0c82b60072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f7ef339-3c55-452b-921d-8e0c82b60072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b59928d-c917-4999-85f0-40f129b6c1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:39 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Volume 24b03f26-7336-4a78-950c-34cb432b0749: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24b03f26-7336-4a78-950c-34cb432b0749', 'volume_size': 1}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1475444966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b03f26-7336-4a78-950c-34cb432b0749,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b7817e4d864eb8a8f2bdc76dd2045e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:40Z,use_quota=True,user_id='7fb20afd62b3490e9c81681bdd674e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Creating volume 24b03f26-7336-4a78-950c-34cb432b0749 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:39 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-24b03f26-7336-4a78-950c-34cb432b0749 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:39 devstack sudo[114109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-24b03f26-7336-4a78-950c-34cb432b0749 1073741824
Aug 12 16:38:39 devstack sudo[114109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:39 devstack sudo[114107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d057aa79-7154-4dab-bc96-0a6769cfdd90
Aug 12 16:38:39 devstack sudo[114107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:39 devstack sudo[114105]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.429s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:39 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Deleted volume successfully.
Aug 12 16:38:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-caf1c77e-80af-41fc-9541-957c12bfe179 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-a957bf02-fcdc-46e5-afa6-ee110fc1790f-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c502dbaa-fd51-4138-9f6e-dd2e71c0d4e3 tempest-CinderUnicodeTest-1339641332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:40 devstack sudo[114107]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d057aa79-7154-4dab-bc96-0a6769cfdd90" returned: 0 in 0.496s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d057aa79-7154-4dab-bc96-0a6769cfdd90 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:40 devstack sudo[114117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d057aa79-7154-4dab-bc96-0a6769cfdd90
Aug 12 16:38:40 devstack sudo[114117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:40 devstack sudo[114109]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-24b03f26-7336-4a78-950c-34cb432b0749 1073741824" returned: 0 in 0.585s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-24b03f26-7336-4a78-950c-34cb432b0749 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:40 devstack sudo[114123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-24b03f26-7336-4a78-950c-34cb432b0749
Aug 12 16:38:40 devstack sudo[114123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:40 devstack sudo[114117]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-d057aa79-7154-4dab-bc96-0a6769cfdd90" returned: 0 in 0.292s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-quobyte-d057aa79-7154-4dab-bc96-0a6769cfdd90" released by "delete_volume" :: held 0.860s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] Created reservations ['999a017d-ea80-41ca-96d6-c32cfb4373c6', '60f0cdfd-6fa9-444a-bfa2-08801a842ea8', '250bfd2f-b6d5-4cfa-906a-06b68e3bfe4f', 'b5e27416-3d6c-4660-bf94-ed9f97aebd74'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:40 devstack sudo[114127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:40 devstack sudo[114127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "cinder-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:40 devstack sudo[114123]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-24b03f26-7336-4a78-950c-34cb432b0749" returned: 0 in 0.314s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c502dbaa-fd51-4138-9f6e-dd2e71c0d4e3 tempest-CinderUnicodeTest-1339641332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.626s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b59928d-c917-4999-85f0-40f129b6c1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b03f26-7336-4a78-950c-34cb432b0749', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9555e432-534e-4190-9e4a-8f416bce4cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-c502dbaa-fd51-4138-9f6e-dd2e71c0d4e3 tempest-CinderUnicodeTest-1339641332 None] Creating offline snapshot 297c0abe-12b1-4072-a914-0c2adf19f9c6 of volume 6bed62f8-66e0-4ac9-a6c5-160eb552b57b {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:38:40 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Volume volume-24b03f26-7336-4a78-950c-34cb432b0749 (24b03f26-7336-4a78-950c-34cb432b0749): created successfully
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9555e432-534e-4190-9e4a-8f416bce4cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Flow 'volume_create_manager' (3dc30243-cd52-4472-9c57-7fbeb2b5a94c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[501e1c68-e90b-42c7-940c-7c867a39b038]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c502dbaa-fd51-4138-9f6e-dd2e71c0d4e3 tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:40 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-8ee15715-8ac4-4806-992f-0a824a49521c tempest-ProjectReaderTests-2045162973 None] Created volume successfully.
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "cinder-quobyte-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-quobyte-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d" acquired by "delete_volume" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9586984-ff0a-4398-b879-06e1ac8aa321]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:40 devstack sudo[114127]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.356s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:40 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:40 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] Deleted volume successfully.
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1092ac0c-302a-4173-99f3-116e3eaa74cc tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-d057aa79-7154-4dab-bc96-0a6769cfdd90-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:41 devstack sudo[114130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b
Aug 12 16:38:41 devstack sudo[114130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:41 devstack sudo[114132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d
Aug 12 16:38:41 devstack sudo[114132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] Acquiring lock "cinder-24b03f26-7336-4a78-950c-34cb432b0749-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] Lock "cinder-24b03f26-7336-4a78-950c-34cb432b0749-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:41 devstack sudo[114130]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c502dbaa-fd51-4138-9f6e-dd2e71c0d4e3 tempest-CinderUnicodeTest-1339641332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b" returned: 0 in 0.463s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c502dbaa-fd51-4138-9f6e-dd2e71c0d4e3 tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] Acquiring lock "cinder-quobyte-24b03f26-7336-4a78-950c-34cb432b0749" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:41 devstack sudo[114140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6 1G
Aug 12 16:38:41 devstack sudo[114140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] Lock "cinder-quobyte-24b03f26-7336-4a78-950c-34cb432b0749" acquired by "delete_volume" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:41 devstack sudo[114132]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c42f8a-e490-43d7-87c9-e04a3a3db11f]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-24b03f26-7336-4a78-950c-34cb432b0749 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d" returned: 0 in 0.454s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:41 devstack sudo[114145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d
Aug 12 16:38:41 devstack sudo[114145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:41 devstack sudo[114144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-24b03f26-7336-4a78-950c-34cb432b0749
Aug 12 16:38:41 devstack sudo[114144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:41 devstack sudo[114145]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d" returned: 0 in 0.272s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-quobyte-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d" released by "delete_volume" :: held 0.774s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Created reservations ['21a6f2cb-20f2-4243-8ed7-fda8564a6897', 'c8863d47-cea9-47cc-82fb-a931db4e8e99', '887e2fee-5811-4abb-9bdb-574ed416ecd5', 'c2afa4a0-ea92-4e7f-9943-c0c502dd79d7'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:41 devstack sudo[114140]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c502dbaa-fd51-4138-9f6e-dd2e71c0d4e3 tempest-CinderUnicodeTest-1339641332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6 1G" returned: 0 in 0.465s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c502dbaa-fd51-4138-9f6e-dd2e71c0d4e3 tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:41 devstack sudo[114144]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-24b03f26-7336-4a78-950c-34cb432b0749" returned: 0 in 0.410s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-24b03f26-7336-4a78-950c-34cb432b0749 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:41 devstack sudo[114156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6
Aug 12 16:38:41 devstack sudo[114156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:41 devstack sudo[114158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-24b03f26-7336-4a78-950c-34cb432b0749
Aug 12 16:38:41 devstack sudo[114158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:41 devstack sudo[114160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:41 devstack sudo[114160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "cinder-9a688b46-c635-40a9-bae8-534747dc42bb-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-9a688b46-c635-40a9-bae8-534747dc42bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:41 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "cinder-quobyte-b9c2d009-95ca-4696-8cff-f61b1faef5c2" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-quobyte-b9c2d009-95ca-4696-8cff-f61b1faef5c2" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "cinder-quobyte-9a688b46-c635-40a9-bae8-534747dc42bb" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-quobyte-9a688b46-c635-40a9-bae8-534747dc42bb" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Deleting offline snapshot 9a688b46-c635-40a9-bae8-534747dc42bb of volume b9c2d009-95ca-4696-8cff-f61b1faef5c2 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] snapshot_file for this snap is: volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4db6f4-0e91-4d62-a5a6-e31a17821977]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:42 devstack sudo[114158]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-24b03f26-7336-4a78-950c-34cb432b0749" returned: 0 in 0.355s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] Lock "cinder-quobyte-24b03f26-7336-4a78-950c-34cb432b0749" released by "delete_volume" :: held 0.848s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:42 devstack sudo[114156]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c502dbaa-fd51-4138-9f6e-dd2e71c0d4e3 tempest-CinderUnicodeTest-1339641332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6" returned: 0 in 0.435s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:42 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-c502dbaa-fd51-4138-9f6e-dd2e71c0d4e3 tempest-CinderUnicodeTest-1339641332 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6 is being set with open permissions: ugo+rw
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c502dbaa-fd51-4138-9f6e-dd2e71c0d4e3 tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:42 devstack sudo[114166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb
Aug 12 16:38:42 devstack sudo[114166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:42 devstack sudo[114167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6
Aug 12 16:38:42 devstack sudo[114167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:42 devstack sudo[114160]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.437s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:42 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Deleted volume successfully.
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] Created reservations ['ef8ce042-01e6-4ffd-b1d5-173064d925b2', 'c8d94b1f-963e-4545-a295-c325ebe590bb', '6add5bf5-6549-4ebb-ac8f-a86a02867c77', 'c08df7e1-0998-4373-90c5-3c9caf9be4c8'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e6ba575a-5f05-4e53-a3f2-bd69819368d9 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-47270cbf-2dd9-4d78-9f4f-8350d4c7ba8d-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:42 devstack sudo[114171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:42 devstack sudo[114171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:42 devstack sudo[114167]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c502dbaa-fd51-4138-9f6e-dd2e71c0d4e3 tempest-CinderUnicodeTest-1339641332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6" returned: 0 in 0.355s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c502dbaa-fd51-4138-9f6e-dd2e71c0d4e3 tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:42 devstack sudo[114177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.info
Aug 12 16:38:42 devstack sudo[114177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:42 devstack sudo[114166]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb" returned: 0 in 0.542s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0864ee-a811-437d-af45-61e65ef09dce]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:42 devstack sudo[114171]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.340s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:42 devstack sudo[114179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2
Aug 12 16:38:42 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] Deleted volume successfully.
Aug 12 16:38:42 devstack sudo[114179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9120fd14-17bf-4595-9e4a-9edc27e7bbb6 tempest-ProjectReaderTests-2045162973 None] Lock "cinder-24b03f26-7336-4a78-950c-34cb432b0749-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:42 devstack sudo[114177]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c502dbaa-fd51-4138-9f6e-dd2e71c0d4e3 tempest-CinderUnicodeTest-1339641332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.info" returned: 0 in 0.353s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:42 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-c502dbaa-fd51-4138-9f6e-dd2e71c0d4e3 tempest-CinderUnicodeTest-1339641332 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.info is being set with open permissions: ugo+rw
Aug 12 16:38:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c502dbaa-fd51-4138-9f6e-dd2e71c0d4e3 tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:42 devstack sudo[114183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.info
Aug 12 16:38:42 devstack sudo[114183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:43 devstack sudo[114179]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2" returned: 0 in 0.407s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:43 devstack sudo[114188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb
Aug 12 16:38:43 devstack sudo[114188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:43 devstack sudo[114183]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c502dbaa-fd51-4138-9f6e-dd2e71c0d4e3 tempest-CinderUnicodeTest-1339641332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.info" returned: 0 in 0.264s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c502dbaa-fd51-4138-9f6e-dd2e71c0d4e3 tempest-CinderUnicodeTest-1339641332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.509s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:43 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c502dbaa-fd51-4138-9f6e-dd2e71c0d4e3 tempest-CinderUnicodeTest-1339641332 None] Create snapshot completed successfully
Aug 12 16:38:43 devstack sudo[114188]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb" returned: 0 in 0.341s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:43 devstack sudo[114194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb
Aug 12 16:38:43 devstack sudo[114194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:43 devstack sudo[114194]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2.9a688b46-c635-40a9-bae8-534747dc42bb" returned: 0 in 0.250s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-quobyte-9a688b46-c635-40a9-bae8-534747dc42bb" released by "_delete_snapshot" :: held 1.695s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-quobyte-b9c2d009-95ca-4696-8cff-f61b1faef5c2" released by "delete_snapshot" :: held 1.730s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:43 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Created reservations ['38666756-3db0-471a-94ec-2f3fc250d26b', '324eb869-4e97-474c-beb6-67df825358bb', '1620435d-258d-4077-8912-3c3e2336496f', 'c26df016-e8b6-49f6-bd86-7920c2d1c173'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:43 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Delete snapshot completed successfully.
Aug 12 16:38:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5f21d2f1-68ec-4983-8b2f-cc1e5af780e4 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-9a688b46-c635-40a9-bae8-534747dc42bb-delete_snapshot" released by "delete_snapshot" :: held 1.895s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:43 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Flow 'volume_create_manager' (987f6c64-21a1-416d-acc4-772797aa3393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:43 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ad147b2-6aad-40e1-aecd-3033f3853f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ad147b2-6aad-40e1-aecd-3033f3853f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1678547359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b7817e4d864eb8a8f2bdc76dd2045e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:44Z,use_quota=True,user_id='7fb20afd62b3490e9c81681bdd674e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddd6355-1b7e-497a-aa8b-2eb766b1bfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddd6355-1b7e-497a-aa8b-2eb766b1bfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c1f2c1-e80b-48fc-b9b9-079064f1ea21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c1f2c1-e80b-48fc-b9b9-079064f1ea21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a', 'volume_name': 'volume-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf0d459-35ae-4d3d-98cd-fa31afca0495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf0d459-35ae-4d3d-98cd-fa31afca0495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470d49fd-9ed8-4d22-9b20-27b954b16098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:44 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Volume 1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a', 'volume_size': 1}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1678547359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b7817e4d864eb8a8f2bdc76dd2045e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:44Z,use_quota=True,user_id='7fb20afd62b3490e9c81681bdd674e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Creating volume 1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:44 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:44 devstack sudo[114197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a 1073741824
Aug 12 16:38:44 devstack sudo[114197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "cinder-b9c2d009-95ca-4696-8cff-f61b1faef5c2-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-b9c2d009-95ca-4696-8cff-f61b1faef5c2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "cinder-quobyte-b9c2d009-95ca-4696-8cff-f61b1faef5c2" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-quobyte-b9c2d009-95ca-4696-8cff-f61b1faef5c2" acquired by "delete_volume" :: waited 0.030s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f4b440-c046-4cef-9efd-447b267fb907]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] Acquiring lock "cinder-297c0abe-12b1-4072-a914-0c2adf19f9c6-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] Lock "cinder-297c0abe-12b1-4072-a914-0c2adf19f9c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] Acquiring lock "cinder-quobyte-6bed62f8-66e0-4ac9-a6c5-160eb552b57b" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] Lock "cinder-quobyte-6bed62f8-66e0-4ac9-a6c5-160eb552b57b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] Acquiring lock "cinder-quobyte-297c0abe-12b1-4072-a914-0c2adf19f9c6" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] Lock "cinder-quobyte-297c0abe-12b1-4072-a914-0c2adf19f9c6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] Deleting offline snapshot 297c0abe-12b1-4072-a914-0c2adf19f9c6 of volume 6bed62f8-66e0-4ac9-a6c5-160eb552b57b {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:38:44 devstack sudo[114201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2
Aug 12 16:38:44 devstack sudo[114201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] snapshot_file for this snap is: volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b7818a-8650-410d-8a3c-36c4c2d8027c]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:44 devstack sudo[114197]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a 1073741824" returned: 0 in 0.642s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:44 devstack sudo[114205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6
Aug 12 16:38:44 devstack sudo[114205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:44 devstack sudo[114209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a
Aug 12 16:38:44 devstack sudo[114209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:44 devstack sudo[114201]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2" returned: 0 in 0.580s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:44 devstack sudo[114213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2
Aug 12 16:38:44 devstack sudo[114213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:45 devstack sudo[114205]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6" returned: 0 in 0.504s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[4793eb29-d41a-4ae0-9ccd-336510e21669]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:45 devstack sudo[114209]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a" returned: 0 in 0.311s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470d49fd-9ed8-4d22-9b20-27b954b16098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05dd635-a5c6-47dd-8eb4-efb1107355de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:45 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Volume volume-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a (1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a): created successfully
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05dd635-a5c6-47dd-8eb4-efb1107355de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Flow 'volume_create_manager' (987f6c64-21a1-416d-acc4-772797aa3393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:45 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-bf4ba0f2-ba9c-430c-8a30-47034c000172 tempest-ProjectReaderTests-2045162973 None] Created volume successfully.
Aug 12 16:38:45 devstack sudo[114219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b
Aug 12 16:38:45 devstack sudo[114219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:45 devstack sudo[114213]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b9c2d009-95ca-4696-8cff-f61b1faef5c2" returned: 0 in 0.297s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-quobyte-b9c2d009-95ca-4696-8cff-f61b1faef5c2" released by "delete_volume" :: held 0.971s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Created reservations ['474267cf-61fa-41d6-aee7-36dd4a17dad3', '1fd058a3-bbb0-4676-9ffe-554ca39800f1', '520366da-e8ab-4e04-8616-cd2e776ac147', '1c82076a-8377-49a1-9d32-bad3152cd598'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:45 devstack sudo[114223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:45 devstack sudo[114223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:45 devstack sudo[114219]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b" returned: 0 in 0.387s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:45 devstack sudo[114228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6
Aug 12 16:38:45 devstack sudo[114228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:45 devstack sudo[114223]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.269s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:45 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Deleted volume successfully.
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7821e18d-fee4-49cf-b8dd-5c0ae7a67705 tempest-CreateVolumesFromSnapshotTest-1713552165 None] Lock "cinder-b9c2d009-95ca-4696-8cff-f61b1faef5c2-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:45 devstack sudo[114228]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6" returned: 0 in 0.342s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:45 devstack sudo[114234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6
Aug 12 16:38:45 devstack sudo[114234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:46 devstack sudo[114234]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b.297c0abe-12b1-4072-a914-0c2adf19f9c6" returned: 0 in 0.259s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] Lock "cinder-quobyte-297c0abe-12b1-4072-a914-0c2adf19f9c6" released by "_delete_snapshot" :: held 1.620s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] Lock "cinder-quobyte-6bed62f8-66e0-4ac9-a6c5-160eb552b57b" released by "delete_snapshot" :: held 1.651s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] Acquiring lock "cinder-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] Lock "cinder-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] Acquiring lock "cinder-quobyte-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:46 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] Created reservations ['02630751-8f4a-4675-92ae-9db47e5b6b1a', 'df59bc9a-7efe-4ccf-ae47-48a689769022', 'abf066da-d981-4cd8-9775-03c9e21b73d6', 'd9d76c00-526e-425d-a440-0697741bbac8'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] Lock "cinder-quobyte-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a" acquired by "delete_volume" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:46 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[4448303c-35ed-4c16-a2c8-b485cf406d25]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:46 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] Delete snapshot completed successfully.
Aug 12 16:38:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-6e87da7b-a7c6-4728-a8d9-6e579a6d059b tempest-CinderUnicodeTest-1339641332 None] Lock "cinder-297c0abe-12b1-4072-a914-0c2adf19f9c6-delete_snapshot" released by "delete_snapshot" :: held 1.904s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:46 devstack sudo[114237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a
Aug 12 16:38:46 devstack sudo[114237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] Acquiring lock "cinder-6bed62f8-66e0-4ac9-a6c5-160eb552b57b-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] Lock "cinder-6bed62f8-66e0-4ac9-a6c5-160eb552b57b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] Acquiring lock "cinder-quobyte-6bed62f8-66e0-4ac9-a6c5-160eb552b57b" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] Lock "cinder-quobyte-6bed62f8-66e0-4ac9-a6c5-160eb552b57b" acquired by "delete_volume" :: waited 0.027s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:46 devstack sudo[114237]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a" returned: 0 in 0.503s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:46 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[892a6196-77be-4a2c-ac4f-0b3f6631a432]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:46 devstack sudo[114242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a
Aug 12 16:38:46 devstack sudo[114242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:46 devstack sudo[114243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b
Aug 12 16:38:46 devstack sudo[114243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:47 devstack sudo[114242]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a" returned: 0 in 0.279s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] Lock "cinder-quobyte-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a" released by "delete_volume" :: held 0.834s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] Created reservations ['ddc22e78-9e13-4d0a-8874-5945933681fa', '636b7392-cbb2-4770-aabe-9ab6b568846e', '450f78a1-5637-4ca5-8898-b12852ceffc6', '06e68f3d-7e14-402b-b050-8ca41dda210c'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:47 devstack sudo[114243]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b" returned: 0 in 0.507s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:47 devstack sudo[114251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:47 devstack sudo[114251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:47 devstack sudo[114252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b
Aug 12 16:38:47 devstack sudo[114252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:47 devstack sudo[114252]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6bed62f8-66e0-4ac9-a6c5-160eb552b57b" returned: 0 in 0.337s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] Lock "cinder-quobyte-6bed62f8-66e0-4ac9-a6c5-160eb552b57b" released by "delete_volume" :: held 0.970s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:47 devstack sudo[114251]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.455s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:47 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] Deleted volume successfully.
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-bc452033-d3c4-41d4-aa3d-9d7b5d06a212 tempest-ProjectReaderTests-2045162973 None] Lock "cinder-1e6b8bae-3ec6-4df8-a2ae-e82f9fd70d4a-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] Created reservations ['3f08c561-d226-4ebd-b402-91f85f098356', '8b85c726-c5d4-4f8d-bbf3-ea3c9b36f6cc', 'd2b85070-03a4-4b00-8781-864ada480c27', '5285b464-1514-4e94-abca-7960626f6210'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:47 devstack sudo[114257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:47 devstack sudo[114257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Flow 'volume_create_manager' (4fe5de27-80c6-4765-827e-bbb499fbad3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2eaf1c-91d1-437c-a3ac-512f5d63d07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc2eaf1c-91d1-437c-a3ac-512f5d63d07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1814288436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2126967-4077-49a5-8f95-400d34fe04ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b7817e4d864eb8a8f2bdc76dd2045e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:48Z,use_quota=True,user_id='7fb20afd62b3490e9c81681bdd674e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5cedcdb-7cef-4f55-82e4-6cbc782cf058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5cedcdb-7cef-4f55-82e4-6cbc782cf058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630ed876-a227-48cd-9332-5309dfa791be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (630ed876-a227-48cd-9332-5309dfa791be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2126967-4077-49a5-8f95-400d34fe04ed', 'volume_name': 'volume-a2126967-4077-49a5-8f95-400d34fe04ed', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa66e087-c785-4c62-929b-d688bc3cac7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa66e087-c785-4c62-929b-d688bc3cac7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945d6c3e-135e-4736-aa70-f67d081bb72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:48 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Volume a2126967-4077-49a5-8f95-400d34fe04ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2126967-4077-49a5-8f95-400d34fe04ed', 'volume_size': 1}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1814288436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2126967-4077-49a5-8f95-400d34fe04ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b7817e4d864eb8a8f2bdc76dd2045e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:48Z,use_quota=True,user_id='7fb20afd62b3490e9c81681bdd674e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Creating volume a2126967-4077-49a5-8f95-400d34fe04ed {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:48 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a2126967-4077-49a5-8f95-400d34fe04ed 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:48 devstack sudo[114259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a2126967-4077-49a5-8f95-400d34fe04ed 1073741824
Aug 12 16:38:48 devstack sudo[114259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:48 devstack sudo[114257]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.360s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:48 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] Deleted volume successfully.
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-52f030f5-282f-426c-b5ec-c6c18c1394ee tempest-CinderUnicodeTest-1339641332 None] Lock "cinder-6bed62f8-66e0-4ac9-a6c5-160eb552b57b-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:48 devstack sudo[114259]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a2126967-4077-49a5-8f95-400d34fe04ed 1073741824" returned: 0 in 0.543s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a2126967-4077-49a5-8f95-400d34fe04ed {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:48 devstack sudo[114266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a2126967-4077-49a5-8f95-400d34fe04ed
Aug 12 16:38:48 devstack sudo[114266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:48 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] Acquiring lock "cinder-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] Lock "cinder-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] Acquiring lock "cinder-quobyte-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:49 devstack sudo[114266]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a2126967-4077-49a5-8f95-400d34fe04ed" returned: 0 in 0.345s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] Lock "cinder-quobyte-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495" acquired by "delete_volume" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945d6c3e-135e-4736-aa70-f67d081bb72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2126967-4077-49a5-8f95-400d34fe04ed', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2d2aee-3817-4957-8d66-99d4a2a1338b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf9d56f-4587-400b-936f-ef826f7c3a40]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:49 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Volume volume-a2126967-4077-49a5-8f95-400d34fe04ed (a2126967-4077-49a5-8f95-400d34fe04ed): created successfully
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2d2aee-3817-4957-8d66-99d4a2a1338b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Flow 'volume_create_manager' (4fe5de27-80c6-4765-827e-bbb499fbad3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:49 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-622be473-8406-4a4e-98e7-29bacae78918 tempest-ProjectReaderTests-2045162973 None] Created volume successfully.
Aug 12 16:38:49 devstack sudo[114269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495
Aug 12 16:38:49 devstack sudo[114269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:49 devstack sudo[114269]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495" returned: 0 in 0.424s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:49 devstack sudo[114274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495
Aug 12 16:38:49 devstack sudo[114274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:49 devstack sudo[114274]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495" returned: 0 in 0.295s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] Lock "cinder-quobyte-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495" released by "delete_volume" :: held 0.771s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] Created reservations ['9e0db7d2-6a04-4afc-bf6c-1c6e07da08f2', 'f7f9838e-d3fc-4369-8a51-3a953e93f8ee', '8e2c56fb-a89d-416b-98c3-d43b50c92894', 'b36263e4-93d1-4d14-afe6-69f07566295f'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:50 devstack sudo[114277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:50 devstack sudo[114277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:50 devstack sudo[114277]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.283s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:50 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] Deleted volume successfully.
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-cd3bf5c8-158e-4e13-aca1-4b3dcca950e0 tempest-CinderUnicodeTest-1339641332 None] Lock "cinder-696ee8cb-cb3a-43ee-b0d5-7f7cbb855495-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] Acquiring lock "cinder-a2126967-4077-49a5-8f95-400d34fe04ed-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] Lock "cinder-a2126967-4077-49a5-8f95-400d34fe04ed-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Flow 'volume_create_manager' (93a431ad-6f76-43dd-a0d2-19a2f125ac82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1b8463-9a6d-49bd-b429-b246cc7445dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a1b8463-9a6d-49bd-b429-b246cc7445dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1969760072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2c8bf7-f0df-4601-ad32-e35941b3a380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf3b6cf6754399a2f4c6270d3e6439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:50Z,use_quota=True,user_id='0c470f4d526e4ef79104bbd16e9b0fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ffce29e-d8d8-48dc-9d3a-642aca75076d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ffce29e-d8d8-48dc-9d3a-642aca75076d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9059cb82-b5d1-434d-90b6-61bc07ad6bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9059cb82-b5d1-434d-90b6-61bc07ad6bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a2c8bf7-f0df-4601-ad32-e35941b3a380', 'volume_name': 'volume-6a2c8bf7-f0df-4601-ad32-e35941b3a380', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2976733-3c92-4f48-a72d-d3f2140bd691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2976733-3c92-4f48-a72d-d3f2140bd691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10315cb2-328d-48d0-8147-76c5c583ee7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:50 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Volume 6a2c8bf7-f0df-4601-ad32-e35941b3a380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a2c8bf7-f0df-4601-ad32-e35941b3a380', 'volume_size': 1}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1969760072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a2c8bf7-f0df-4601-ad32-e35941b3a380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf3b6cf6754399a2f4c6270d3e6439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:50Z,use_quota=True,user_id='0c470f4d526e4ef79104bbd16e9b0fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Creating volume 6a2c8bf7-f0df-4601-ad32-e35941b3a380 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:50 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6a2c8bf7-f0df-4601-ad32-e35941b3a380 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] Acquiring lock "cinder-quobyte-a2126967-4077-49a5-8f95-400d34fe04ed" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:50 devstack sudo[114281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6a2c8bf7-f0df-4601-ad32-e35941b3a380 1073741824
Aug 12 16:38:50 devstack sudo[114281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] Lock "cinder-quobyte-a2126967-4077-49a5-8f95-400d34fe04ed" acquired by "delete_volume" :: waited 0.031s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4f7241-be97-4556-b27c-3c9206ba8d2d]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a2126967-4077-49a5-8f95-400d34fe04ed {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:51 devstack sudo[114283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a2126967-4077-49a5-8f95-400d34fe04ed
Aug 12 16:38:51 devstack sudo[114283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:51 devstack sudo[114281]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6a2c8bf7-f0df-4601-ad32-e35941b3a380 1073741824" returned: 0 in 0.523s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:51 devstack sudo[114283]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a2126967-4077-49a5-8f95-400d34fe04ed" returned: 0 in 0.428s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a2126967-4077-49a5-8f95-400d34fe04ed {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:51 devstack sudo[114292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a2126967-4077-49a5-8f95-400d34fe04ed
Aug 12 16:38:51 devstack sudo[114292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6a2c8bf7-f0df-4601-ad32-e35941b3a380 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:51 devstack sudo[114294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6a2c8bf7-f0df-4601-ad32-e35941b3a380
Aug 12 16:38:51 devstack sudo[114294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:51 devstack sudo[114292]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-a2126967-4077-49a5-8f95-400d34fe04ed" returned: 0 in 0.325s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] Lock "cinder-quobyte-a2126967-4077-49a5-8f95-400d34fe04ed" released by "delete_volume" :: held 0.814s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:51 devstack sudo[114294]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6a2c8bf7-f0df-4601-ad32-e35941b3a380" returned: 0 in 0.336s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10315cb2-328d-48d0-8147-76c5c583ee7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a2c8bf7-f0df-4601-ad32-e35941b3a380', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fdbc15-2c8c-44ee-b5a6-f636131b286e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:51 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Volume volume-6a2c8bf7-f0df-4601-ad32-e35941b3a380 (6a2c8bf7-f0df-4601-ad32-e35941b3a380): created successfully
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4fdbc15-2c8c-44ee-b5a6-f636131b286e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Flow 'volume_create_manager' (93a431ad-6f76-43dd-a0d2-19a2f125ac82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] Created reservations ['111538b0-b46c-4cbd-a6c9-b1b7fb3c4b59', '9456a5af-e150-4fa0-932f-dd20641cd4a3', '51bfad7a-de0c-459d-b0d4-f2900afdd59d', 'd4cca61c-67bf-434e-82db-e8047dd3ed13'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:51 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a9ee220e-3daf-4e43-8825-4f4962504524 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Created volume successfully.
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:51 devstack sudo[114298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:51 devstack sudo[114298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:52 devstack sudo[114298]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.261s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:52 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:52 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] Deleted volume successfully.
Aug 12 16:38:52 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1c09740b-1de9-4709-b695-21ec03fa637d tempest-ProjectReaderTests-2045162973 None] Lock "cinder-a2126967-4077-49a5-8f95-400d34fe04ed-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Flow 'volume_create_manager' (b015e089-c7cf-4032-a7e6-8bc6f5bf3d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dadd44af-53cb-48d4-b426-f4046e817ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dadd44af-53cb-48d4-b426-f4046e817ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1032086813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e531bd-08b9-4102-bc86-d24750b92522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf3b6cf6754399a2f4c6270d3e6439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:54Z,use_quota=True,user_id='0c470f4d526e4ef79104bbd16e9b0fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896ad1b0-b331-4485-9fe7-c483f3c8e64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896ad1b0-b331-4485-9fe7-c483f3c8e64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffc0b3f-02ee-4458-af9b-e991c964845c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffc0b3f-02ee-4458-af9b-e991c964845c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e531bd-08b9-4102-bc86-d24750b92522', 'volume_name': 'volume-44e531bd-08b9-4102-bc86-d24750b92522', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7451e422-05d8-4750-80a2-085551f5c66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7451e422-05d8-4750-80a2-085551f5c66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cae6e18-19a6-4565-95d0-325ec0d38a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:54 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Volume 44e531bd-08b9-4102-bc86-d24750b92522: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e531bd-08b9-4102-bc86-d24750b92522', 'volume_size': 1}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1032086813',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e531bd-08b9-4102-bc86-d24750b92522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf3b6cf6754399a2f4c6270d3e6439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:54Z,use_quota=True,user_id='0c470f4d526e4ef79104bbd16e9b0fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Creating volume 44e531bd-08b9-4102-bc86-d24750b92522 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:54 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44e531bd-08b9-4102-bc86-d24750b92522 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:54 devstack sudo[114307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44e531bd-08b9-4102-bc86-d24750b92522 1073741824
Aug 12 16:38:54 devstack sudo[114307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Flow 'volume_create_manager' (d9534f91-e223-47c7-87c1-2622b383b6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a320da77-3634-4b3c-b821-66e497eddc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a320da77-3634-4b3c-b821-66e497eddc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-897804413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cdeb36f-b9a6-4b49-ac16-f985450a0d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf3b6cf6754399a2f4c6270d3e6439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:54Z,use_quota=True,user_id='0c470f4d526e4ef79104bbd16e9b0fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b914505a-2fda-4959-9556-fac94d612645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b914505a-2fda-4959-9556-fac94d612645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df3aa5d-25fc-4c1d-8147-47013eda692f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df3aa5d-25fc-4c1d-8147-47013eda692f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cdeb36f-b9a6-4b49-ac16-f985450a0d5f', 'volume_name': 'volume-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad271b6-1125-48a0-a4b5-483bb7baacf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad271b6-1125-48a0-a4b5-483bb7baacf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9172ec5-bc7b-4ce7-95e4-55dec4ddd93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:54 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Volume 5cdeb36f-b9a6-4b49-ac16-f985450a0d5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f', 'volume_size': 1}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Flow 'volume_create_manager' (c984442f-210a-4f84-b9d5-ae2ecbdca775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c1d751-bc81-4601-9670-863a73d70fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c1d751-bc81-4601-9670-863a73d70fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-576511891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffdee820-adf1-4aae-9c53-92e40ffc5b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b7817e4d864eb8a8f2bdc76dd2045e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:54Z,use_quota=True,user_id='7fb20afd62b3490e9c81681bdd674e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bea7559-fb0e-4c58-abd8-dc58160b8a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bea7559-fb0e-4c58-abd8-dc58160b8a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b52e04-b149-4fbf-87f2-8c16f68fa4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6b52e04-b149-4fbf-87f2-8c16f68fa4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffdee820-adf1-4aae-9c53-92e40ffc5b11', 'volume_name': 'volume-ffdee820-adf1-4aae-9c53-92e40ffc5b11', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e83381-4416-437f-b7b5-62966786f762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e83381-4416-437f-b7b5-62966786f762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (888dfa63-20b4-4098-a494-7f6e7d7c7993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:54 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Volume ffdee820-adf1-4aae-9c53-92e40ffc5b11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffdee820-adf1-4aae-9c53-92e40ffc5b11', 'volume_size': 1}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:54 devstack sudo[114307]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44e531bd-08b9-4102-bc86-d24750b92522 1073741824" returned: 0 in 0.607s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Flow 'volume_create_manager' (13d6a8da-bfcc-4376-969d-847e2ddfe847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c43a7c-b3d3-449e-b09e-b79f84f239e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44e531bd-08b9-4102-bc86-d24750b92522 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c43a7c-b3d3-449e-b09e-b79f84f239e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1441356922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73b0d44-7e78-4573-a471-b9756ace7ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf3b6cf6754399a2f4c6270d3e6439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:55Z,use_quota=True,user_id='0c470f4d526e4ef79104bbd16e9b0fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a376d5f2-947b-4696-bd86-faa89cc31ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a376d5f2-947b-4696-bd86-faa89cc31ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:55 devstack sudo[114317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44e531bd-08b9-4102-bc86-d24750b92522
Aug 12 16:38:55 devstack sudo[114317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b51025-0291-4705-9aaa-e718a1377371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93b51025-0291-4705-9aaa-e718a1377371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e73b0d44-7e78-4573-a471-b9756ace7ca5', 'volume_name': 'volume-e73b0d44-7e78-4573-a471-b9756ace7ca5', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06fe41f-c131-42ea-bc66-81dc6eb9a764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b06fe41f-c131-42ea-bc66-81dc6eb9a764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0251f850-e09d-4822-b3cb-5bf70d561522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Volume e73b0d44-7e78-4573-a471-b9756ace7ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e73b0d44-7e78-4573-a471-b9756ace7ca5', 'volume_size': 1}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Flow 'volume_create_manager' (9f4638a0-1690-4222-9565-b36695b87936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fc4538-57c9-4b8d-baa6-756753dabcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Flow 'volume_create_manager' (0c6e992c-529d-49ad-8c44-8489759981c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5382ca7a-84f4-4a8b-858f-616bb1e63a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Flow 'volume_create_manager' (c81cd82f-6784-4628-a392-c0d87026dba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42550493-2f78-461c-af33-d265a662b1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6fc4538-57c9-4b8d-baa6-756753dabcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1860837672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9945b4-312b-4a0c-902e-c246290ebbe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf3b6cf6754399a2f4c6270d3e6439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:55Z,use_quota=True,user_id='0c470f4d526e4ef79104bbd16e9b0fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a86254e-4a1b-499f-9b24-bee8f81ffcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a86254e-4a1b-499f-9b24-bee8f81ffcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a316ff0c-de2d-4c5e-be5e-b4fe262eb4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a316ff0c-de2d-4c5e-be5e-b4fe262eb4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a9945b4-312b-4a0c-902e-c246290ebbe3', 'volume_name': 'volume-5a9945b4-312b-4a0c-902e-c246290ebbe3', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17abb8a3-701e-48e6-86fa-43f455cdd161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17abb8a3-701e-48e6-86fa-43f455cdd161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8742ad40-cbd6-4eb5-9365-d4d1ea346ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Volume 5a9945b4-312b-4a0c-902e-c246290ebbe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a9945b4-312b-4a0c-902e-c246290ebbe3', 'volume_size': 1}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42550493-2f78-461c-af33-d265a662b1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1773867289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43993349-8505-404c-bcb3-b8d27a633768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf3b6cf6754399a2f4c6270d3e6439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:55Z,use_quota=True,user_id='0c470f4d526e4ef79104bbd16e9b0fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:55 devstack sudo[114317]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737e6476-0bdf-4575-af24-8d9f75c94b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (737e6476-0bdf-4575-af24-8d9f75c94b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfe0af2-7a26-47b2-a518-9bdb27f80bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfe0af2-7a26-47b2-a518-9bdb27f80bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43993349-8505-404c-bcb3-b8d27a633768', 'volume_name': 'volume-43993349-8505-404c-bcb3-b8d27a633768', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5165b677-2612-44c2-abff-db0704825fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5165b677-2612-44c2-abff-db0704825fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5fb73fa-526e-42af-9730-359778449f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Volume 43993349-8505-404c-bcb3-b8d27a633768: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43993349-8505-404c-bcb3-b8d27a633768', 'volume_size': 1}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44e531bd-08b9-4102-bc86-d24750b92522" returned: 0 in 0.406s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.804s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-897804413',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cdeb36f-b9a6-4b49-ac16-f985450a0d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf3b6cf6754399a2f4c6270d3e6439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:54Z,use_quota=True,user_id='0c470f4d526e4ef79104bbd16e9b0fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Creating volume 5cdeb36f-b9a6-4b49-ac16-f985450a0d5f {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:55 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5382ca7a-84f4-4a8b-858f-616bb1e63a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-650287564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6878aaf0-2235-453f-9f4d-359605a6571c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f0fddecd2b4bc19bba9332ad6df36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:55Z,use_quota=True,user_id='f37e9ccd07084ed58fdecd76f5c57dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bdfc865-6e8a-485e-bdf2-7e2dfa905b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack sudo[114320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f 1073741824
Aug 12 16:38:55 devstack sudo[114320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bdfc865-6e8a-485e-bdf2-7e2dfa905b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d9212e-13e8-4520-a0ac-f46194a37e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76d9212e-13e8-4520-a0ac-f46194a37e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6878aaf0-2235-453f-9f4d-359605a6571c', 'volume_name': 'volume-6878aaf0-2235-453f-9f4d-359605a6571c', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07476545-aba7-4c24-8edf-77ee830f33f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07476545-aba7-4c24-8edf-77ee830f33f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539764fe-b1cb-41a1-9192-a6a10415a019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Volume 6878aaf0-2235-453f-9f4d-359605a6571c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6878aaf0-2235-453f-9f4d-359605a6571c', 'volume_size': 1}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cae6e18-19a6-4565-95d0-325ec0d38a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e531bd-08b9-4102-bc86-d24750b92522', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87010c53-243e-4ba0-abcb-1c252691c845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:55 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Volume volume-44e531bd-08b9-4102-bc86-d24750b92522 (44e531bd-08b9-4102-bc86-d24750b92522): created successfully
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87010c53-243e-4ba0-abcb-1c252691c845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Flow 'volume_create_manager' (b015e089-c7cf-4032-a7e6-8bc6f5bf3d94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:55 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-1bd1f67b-46b0-4a5e-b013-dc9debbe488e tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Created volume successfully.
Aug 12 16:38:55 devstack sudo[114320]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f 1073741824" returned: 0 in 0.429s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:55 devstack sudo[114326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f
Aug 12 16:38:55 devstack sudo[114326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:56 devstack sudo[114326]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f" returned: 0 in 0.245s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.423s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-576511891',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffdee820-adf1-4aae-9c53-92e40ffc5b11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b7817e4d864eb8a8f2bdc76dd2045e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:54Z,use_quota=True,user_id='7fb20afd62b3490e9c81681bdd674e82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Creating volume ffdee820-adf1-4aae-9c53-92e40ffc5b11 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:56 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ffdee820-adf1-4aae-9c53-92e40ffc5b11 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9172ec5-bc7b-4ce7-95e4-55dec4ddd93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a453859-c607-4faa-901d-37f980ed763a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:56 devstack sudo[114329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ffdee820-adf1-4aae-9c53-92e40ffc5b11 1073741824
Aug 12 16:38:56 devstack sudo[114329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:56 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Volume volume-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f (5cdeb36f-b9a6-4b49-ac16-f985450a0d5f): created successfully
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a453859-c607-4faa-901d-37f980ed763a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Flow 'volume_create_manager' (d9534f91-e223-47c7-87c1-2622b383b6c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:56 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-b8f8cb8c-873d-492a-84f6-bdbeaf3120cb tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Created volume successfully.
Aug 12 16:38:56 devstack sudo[114329]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ffdee820-adf1-4aae-9c53-92e40ffc5b11 1073741824" returned: 0 in 0.464s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ffdee820-adf1-4aae-9c53-92e40ffc5b11 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:56 devstack sudo[114335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ffdee820-adf1-4aae-9c53-92e40ffc5b11
Aug 12 16:38:56 devstack sudo[114335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:56 devstack sudo[114335]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ffdee820-adf1-4aae-9c53-92e40ffc5b11" returned: 0 in 0.264s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.809s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1441356922',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73b0d44-7e78-4573-a471-b9756ace7ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf3b6cf6754399a2f4c6270d3e6439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:55Z,use_quota=True,user_id='0c470f4d526e4ef79104bbd16e9b0fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Creating volume e73b0d44-7e78-4573-a471-b9756ace7ca5 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:56 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e73b0d44-7e78-4573-a471-b9756ace7ca5 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (888dfa63-20b4-4098-a494-7f6e7d7c7993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffdee820-adf1-4aae-9c53-92e40ffc5b11', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05be434e-debd-4151-8bec-8aa0f20d0409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:56 devstack sudo[114338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e73b0d44-7e78-4573-a471-b9756ace7ca5 1073741824
Aug 12 16:38:56 devstack sudo[114338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:56 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Volume volume-ffdee820-adf1-4aae-9c53-92e40ffc5b11 (ffdee820-adf1-4aae-9c53-92e40ffc5b11): created successfully
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05be434e-debd-4151-8bec-8aa0f20d0409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:56 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Flow 'volume_create_manager' (c984442f-210a-4f84-b9d5-ae2ecbdca775) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:57 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e02cc0ae-09ed-4714-8a2a-a40d8b23df8d tempest-ProjectReaderTests-2045162973 None] Created volume successfully.
Aug 12 16:38:57 devstack sudo[114338]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e73b0d44-7e78-4573-a471-b9756ace7ca5 1073741824" returned: 0 in 0.442s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e73b0d44-7e78-4573-a471-b9756ace7ca5 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:57 devstack sudo[114344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e73b0d44-7e78-4573-a471-b9756ace7ca5
Aug 12 16:38:57 devstack sudo[114344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:57 devstack sudo[114344]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e73b0d44-7e78-4573-a471-b9756ace7ca5" returned: 0 in 0.272s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.335s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1860837672',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9945b4-312b-4a0c-902e-c246290ebbe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf3b6cf6754399a2f4c6270d3e6439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:55Z,use_quota=True,user_id='0c470f4d526e4ef79104bbd16e9b0fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Creating volume 5a9945b4-312b-4a0c-902e-c246290ebbe3 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:57 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a9945b4-312b-4a0c-902e-c246290ebbe3 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0251f850-e09d-4822-b3cb-5bf70d561522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e73b0d44-7e78-4573-a471-b9756ace7ca5', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:57 devstack sudo[114347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a9945b4-312b-4a0c-902e-c246290ebbe3 1073741824
Aug 12 16:38:57 devstack sudo[114347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d5ff4d-28e3-4dfb-aa8d-615ca896f6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:57 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Volume volume-e73b0d44-7e78-4573-a471-b9756ace7ca5 (e73b0d44-7e78-4573-a471-b9756ace7ca5): created successfully
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3d5ff4d-28e3-4dfb-aa8d-615ca896f6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Flow 'volume_create_manager' (13d6a8da-bfcc-4376-969d-847e2ddfe847) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:57 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-d7d0c7c8-c3e8-4d95-8031-f79b0f5d1029 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Created volume successfully.
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] Acquiring lock "cinder-ffdee820-adf1-4aae-9c53-92e40ffc5b11-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] Lock "cinder-ffdee820-adf1-4aae-9c53-92e40ffc5b11-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] Acquiring lock "cinder-quobyte-ffdee820-adf1-4aae-9c53-92e40ffc5b11" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] Lock "cinder-quobyte-ffdee820-adf1-4aae-9c53-92e40ffc5b11" acquired by "delete_volume" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[8157ed36-21cf-4c38-9ef0-44fadb5740f4]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ffdee820-adf1-4aae-9c53-92e40ffc5b11 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:58 devstack sudo[114347]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:58 devstack sudo[114352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ffdee820-adf1-4aae-9c53-92e40ffc5b11
Aug 12 16:38:58 devstack sudo[114352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a9945b4-312b-4a0c-902e-c246290ebbe3 1073741824" returned: 0 in 0.568s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a9945b4-312b-4a0c-902e-c246290ebbe3 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:58 devstack sudo[114355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a9945b4-312b-4a0c-902e-c246290ebbe3
Aug 12 16:38:58 devstack sudo[114355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:58 devstack sudo[114352]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ffdee820-adf1-4aae-9c53-92e40ffc5b11" returned: 0 in 0.466s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ffdee820-adf1-4aae-9c53-92e40ffc5b11 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:58 devstack sudo[114361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ffdee820-adf1-4aae-9c53-92e40ffc5b11
Aug 12 16:38:58 devstack sudo[114361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:58 devstack sudo[114355]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a9945b4-312b-4a0c-902e-c246290ebbe3" returned: 0 in 0.312s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.211s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1773867289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43993349-8505-404c-bcb3-b8d27a633768,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdaf3b6cf6754399a2f4c6270d3e6439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:55Z,use_quota=True,user_id='0c470f4d526e4ef79104bbd16e9b0fb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Creating volume 43993349-8505-404c-bcb3-b8d27a633768 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:58 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43993349-8505-404c-bcb3-b8d27a633768 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8742ad40-cbd6-4eb5-9365-d4d1ea346ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a9945b4-312b-4a0c-902e-c246290ebbe3', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896b6140-0b0b-4d09-bb3e-71add7aa6a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:58 devstack sudo[114363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43993349-8505-404c-bcb3-b8d27a633768 1073741824
Aug 12 16:38:58 devstack sudo[114363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:58 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Volume volume-5a9945b4-312b-4a0c-902e-c246290ebbe3 (5a9945b4-312b-4a0c-902e-c246290ebbe3): created successfully
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (896b6140-0b0b-4d09-bb3e-71add7aa6a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Flow 'volume_create_manager' (9f4638a0-1690-4222-9565-b36695b87936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:58 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-0134926e-d2c7-479a-816d-9e1e518cd8fc tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Created volume successfully.
Aug 12 16:38:58 devstack sudo[114361]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-ffdee820-adf1-4aae-9c53-92e40ffc5b11" returned: 0 in 0.275s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] Lock "cinder-quobyte-ffdee820-adf1-4aae-9c53-92e40ffc5b11" released by "delete_volume" :: held 0.797s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] Created reservations ['5f602fb6-5a10-4ab6-901b-97381429135c', '2623a800-7554-48af-964e-a398a6cd00d5', '2b576c74-a457-4f39-b8d8-b41ea39cf03a', '6bd230a5-28d7-4824-9a3c-34812793a104'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:59 devstack sudo[114369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:38:59 devstack sudo[114369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:59 devstack sudo[114363]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43993349-8505-404c-bcb3-b8d27a633768 1073741824" returned: 0 in 0.545s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43993349-8505-404c-bcb3-b8d27a633768 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:59 devstack sudo[114373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43993349-8505-404c-bcb3-b8d27a633768
Aug 12 16:38:59 devstack sudo[114373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:59 devstack sudo[114369]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.321s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:38:59 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] Deleted volume successfully.
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e2cb34e5-d59c-4b5b-9e23-d4731edff443 tempest-ProjectReaderTests-2045162973 None] Lock "cinder-ffdee820-adf1-4aae-9c53-92e40ffc5b11-delete_volume" released by "delete_volume" :: held 1.378s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:38:59 devstack sudo[114373]: pam_unix(sudo:session): session closed for user root
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43993349-8505-404c-bcb3-b8d27a633768" returned: 0 in 0.347s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.091s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-650287564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6878aaf0-2235-453f-9f4d-359605a6571c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f0fddecd2b4bc19bba9332ad6df36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:38:55Z,use_quota=True,user_id='f37e9ccd07084ed58fdecd76f5c57dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Creating volume 6878aaf0-2235-453f-9f4d-359605a6571c {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:38:59 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5fb73fa-526e-42af-9730-359778449f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43993349-8505-404c-bcb3-b8d27a633768', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:59 devstack sudo[114376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c 1073741824
Aug 12 16:38:59 devstack sudo[114376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130cd927-7a65-4a4e-ba86-f9f4cbf7e9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:38:59 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Volume volume-43993349-8505-404c-bcb3-b8d27a633768 (43993349-8505-404c-bcb3-b8d27a633768): created successfully
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (130cd927-7a65-4a4e-ba86-f9f4cbf7e9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:38:59 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Flow 'volume_create_manager' (c81cd82f-6784-4628-a392-c0d87026dba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:38:59 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-908ccf90-c9f2-44eb-b37a-c5283b8af654 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Created volume successfully.
Aug 12 16:39:00 devstack sudo[114376]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c 1073741824" returned: 0 in 0.535s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:00 devstack sudo[114382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c
Aug 12 16:39:00 devstack sudo[114382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:00 devstack sudo[114382]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c" returned: 0 in 0.301s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:39:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539764fe-b1cb-41a1-9192-a6a10415a019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6878aaf0-2235-453f-9f4d-359605a6571c', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38acfe85-cc8a-4185-a8f6-72fab0e92445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:00 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Volume volume-6878aaf0-2235-453f-9f4d-359605a6571c (6878aaf0-2235-453f-9f4d-359605a6571c): created successfully
Aug 12 16:39:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38acfe85-cc8a-4185-a8f6-72fab0e92445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Flow 'volume_create_manager' (0c6e992c-529d-49ad-8c44-8489759981c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:39:00 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "cinder-43993349-8505-404c-bcb3-b8d27a633768-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:00 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-170a8942-4ba1-4d54-9a6d-b83d3a79ca22 tempest-ProjectMemberTests-1974885304 None] Created volume successfully.
Aug 12 16:39:00 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-43993349-8505-404c-bcb3-b8d27a633768-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:00 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "cinder-quobyte-43993349-8505-404c-bcb3-b8d27a633768" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:00 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-quobyte-43993349-8505-404c-bcb3-b8d27a633768" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:00 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c4a60f-4281-4fc4-b231-7ded20ac3e44]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43993349-8505-404c-bcb3-b8d27a633768 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:00 devstack sudo[114386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43993349-8505-404c-bcb3-b8d27a633768
Aug 12 16:39:00 devstack sudo[114386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:01 devstack sudo[114386]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43993349-8505-404c-bcb3-b8d27a633768" returned: 0 in 0.492s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43993349-8505-404c-bcb3-b8d27a633768 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:01 devstack sudo[114391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43993349-8505-404c-bcb3-b8d27a633768
Aug 12 16:39:01 devstack sudo[114391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:UPDATE=275,cinder:SELECT=198,cinder:INSERT=77,cinder:DELETE=26 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=209,cinder:UPDATE=279,cinder:DELETE=26,cinder:INSERT=69 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c04142d3-c402-4dc9-9378-1ced6b8dd44c tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c04142d3-c402-4dc9-9378-1ced6b8dd44c tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Flow 'volume_create_manager' (b76efffa-86f4-4ba0-912a-c0b9aed80889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ca3e9d-8b0c-4f44-afc6-aa4a8c963897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ca3e9d-8b0c-4f44-afc6-aa4a8c963897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1220942920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0640c2d6-eb45-4b40-9802-7052949252dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b0f0e99635483ebea15d7628018498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:39:01Z,use_quota=True,user_id='7fb2148ba79148259002a82bbe23cc36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa7412b-a935-4b55-91e7-d67c21e721be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa7412b-a935-4b55-91e7-d67c21e721be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be7abeac-3c2b-468e-9061-00205e295f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be7abeac-3c2b-468e-9061-00205e295f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0640c2d6-eb45-4b40-9802-7052949252dd', 'volume_name': 'volume-0640c2d6-eb45-4b40-9802-7052949252dd', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:01 devstack sudo[114391]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b100e691-3ec6-4449-af70-0221cf42412b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b100e691-3ec6-4449-af70-0221cf42412b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5bd5329-f150-44a8-9399-455f235ecdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:01 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Volume 0640c2d6-eb45-4b40-9802-7052949252dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0640c2d6-eb45-4b40-9802-7052949252dd', 'volume_size': 1}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-c04142d3-c402-4dc9-9378-1ced6b8dd44c tempest-ProjectMemberTests-1974885304 None] Creating offline snapshot 246bdbc7-61fc-4789-a5b4-df06a7644241 of volume 6878aaf0-2235-453f-9f4d-359605a6571c {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43993349-8505-404c-bcb3-b8d27a633768" returned: 0 in 0.328s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b90931-0b65-4ee9-bfe9-3fa37bef6582]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-quobyte-43993349-8505-404c-bcb3-b8d27a633768" released by "delete_volume" :: held 0.880s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c04142d3-c402-4dc9-9378-1ced6b8dd44c tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Created reservations ['004f5077-dc9a-4905-8ba2-87c311a7d85b', 'd1a6c51b-b3e1-47ea-8466-8c6e479aa54e', '617c07ea-b225-4691-80f4-37efcc1a076c', '6eabfd49-9bb9-4dac-a76c-4f4f7b095229'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:01 devstack sudo[114394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c
Aug 12 16:39:01 devstack sudo[114394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:01 devstack sudo[114396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:39:01 devstack sudo[114396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "cinder-5a9945b4-312b-4a0c-902e-c246290ebbe3-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-5a9945b4-312b-4a0c-902e-c246290ebbe3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "cinder-quobyte-5a9945b4-312b-4a0c-902e-c246290ebbe3" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-quobyte-5a9945b4-312b-4a0c-902e-c246290ebbe3" acquired by "delete_volume" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c91da8-a7f6-4227-b33d-17d240d85848]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a9945b4-312b-4a0c-902e-c246290ebbe3 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:01 devstack sudo[114394]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c04142d3-c402-4dc9-9378-1ced6b8dd44c tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c" returned: 0 in 0.407s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c04142d3-c402-4dc9-9378-1ced6b8dd44c tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:01 devstack sudo[114396]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.293s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:39:02 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Deleted volume successfully.
Aug 12 16:39:02 devstack sudo[114399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a9945b4-312b-4a0c-902e-c246290ebbe3
Aug 12 16:39:02 devstack sudo[114399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:02 devstack sudo[114403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241 1G
Aug 12 16:39:02 devstack sudo[114403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-46b0e35d-b026-4b6a-9083-1f7f13ab0f23 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-43993349-8505-404c-bcb3-b8d27a633768-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:02 devstack sudo[114399]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a9945b4-312b-4a0c-902e-c246290ebbe3" returned: 0 in 0.399s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a9945b4-312b-4a0c-902e-c246290ebbe3 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:02 devstack sudo[114413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a9945b4-312b-4a0c-902e-c246290ebbe3
Aug 12 16:39:02 devstack sudo[114413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:02 devstack sudo[114403]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c04142d3-c402-4dc9-9378-1ced6b8dd44c tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241 1G" returned: 0 in 0.434s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c04142d3-c402-4dc9-9378-1ced6b8dd44c tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6878aaf0-2235-453f-9f4d-359605a6571c -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:02 devstack sudo[114416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6878aaf0-2235-453f-9f4d-359605a6571c -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241
Aug 12 16:39:02 devstack sudo[114416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:02 devstack sudo[114413]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5a9945b4-312b-4a0c-902e-c246290ebbe3" returned: 0 in 0.252s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-quobyte-5a9945b4-312b-4a0c-902e-c246290ebbe3" released by "delete_volume" :: held 0.694s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Created reservations ['d17796e3-8579-41b1-9539-8c54d180269f', 'b15413d6-39e2-47bc-b93c-5bd3d710c7b3', 'e5846266-68ed-49ca-91cd-5144e29750f7', 'ad03df7c-4b03-4100-8ba4-31f21f9546f4'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:02 devstack sudo[114422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:39:02 devstack sudo[114422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:02 devstack sudo[114416]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c04142d3-c402-4dc9-9378-1ced6b8dd44c tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6878aaf0-2235-453f-9f4d-359605a6571c -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241" returned: 0 in 0.311s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:02 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-c04142d3-c402-4dc9-9378-1ced6b8dd44c tempest-ProjectMemberTests-1974885304 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241 is being set with open permissions: ugo+rw
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c04142d3-c402-4dc9-9378-1ced6b8dd44c tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:02 devstack sudo[114424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241
Aug 12 16:39:02 devstack sudo[114424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:02 devstack sudo[114422]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.257s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:39:02 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Deleted volume successfully.
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e658abf0-0df1-4197-a060-b033229bc6da tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-5a9945b4-312b-4a0c-902e-c246290ebbe3-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:02 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "cinder-e73b0d44-7e78-4573-a471-b9756ace7ca5-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:02 devstack sudo[114424]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c04142d3-c402-4dc9-9378-1ced6b8dd44c tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241" returned: 0 in 0.271s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-e73b0d44-7e78-4573-a471-b9756ace7ca5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c04142d3-c402-4dc9-9378-1ced6b8dd44c tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "cinder-quobyte-e73b0d44-7e78-4573-a471-b9756ace7ca5" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:03 devstack sudo[114428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.info
Aug 12 16:39:03 devstack sudo[114428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-quobyte-e73b0d44-7e78-4573-a471-b9756ace7ca5" acquired by "delete_volume" :: waited 0.020s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5009c3-66ab-4c1d-a78d-f631411babe3]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e73b0d44-7e78-4573-a471-b9756ace7ca5 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:03 devstack sudo[114430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e73b0d44-7e78-4573-a471-b9756ace7ca5
Aug 12 16:39:03 devstack sudo[114430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:03 devstack sudo[114428]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c04142d3-c402-4dc9-9378-1ced6b8dd44c tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.info" returned: 0 in 0.272s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:03 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-c04142d3-c402-4dc9-9378-1ced6b8dd44c tempest-ProjectMemberTests-1974885304 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.info is being set with open permissions: ugo+rw
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c04142d3-c402-4dc9-9378-1ced6b8dd44c tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:03 devstack sudo[114433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.info
Aug 12 16:39:03 devstack sudo[114433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:03 devstack sudo[114430]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e73b0d44-7e78-4573-a471-b9756ace7ca5" returned: 0 in 0.358s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e73b0d44-7e78-4573-a471-b9756ace7ca5 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:03 devstack sudo[114438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e73b0d44-7e78-4573-a471-b9756ace7ca5
Aug 12 16:39:03 devstack sudo[114438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:03 devstack sudo[114433]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c04142d3-c402-4dc9-9378-1ced6b8dd44c tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.info" returned: 0 in 0.264s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-c04142d3-c402-4dc9-9378-1ced6b8dd44c tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.059s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1220942920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0640c2d6-eb45-4b40-9802-7052949252dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b0f0e99635483ebea15d7628018498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:39:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:39:01Z,use_quota=True,user_id='7fb2148ba79148259002a82bbe23cc36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Creating volume 0640c2d6-eb45-4b40-9802-7052949252dd {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:39:03 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0640c2d6-eb45-4b40-9802-7052949252dd 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:03 devstack sudo[114441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0640c2d6-eb45-4b40-9802-7052949252dd 1073741824
Aug 12 16:39:03 devstack sudo[114441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:03 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c04142d3-c402-4dc9-9378-1ced6b8dd44c tempest-ProjectMemberTests-1974885304 None] Create snapshot completed successfully
Aug 12 16:39:03 devstack sudo[114438]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e73b0d44-7e78-4573-a471-b9756ace7ca5" returned: 0 in 0.255s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-quobyte-e73b0d44-7e78-4573-a471-b9756ace7ca5" released by "delete_volume" :: held 0.660s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Created reservations ['c8d543a7-2fbe-48a2-8029-42ea9bdddda0', 'e943f8e7-00b0-42a1-877b-e011f3a125f8', '473b8e74-3246-437e-8af4-7c1d30d51e47', '6d086a7a-7087-4736-9803-3366de04f778'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:03 devstack sudo[114446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:39:03 devstack sudo[114446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:04 devstack sudo[114441]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0640c2d6-eb45-4b40-9802-7052949252dd 1073741824" returned: 0 in 0.435s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0640c2d6-eb45-4b40-9802-7052949252dd {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:04 devstack sudo[114450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0640c2d6-eb45-4b40-9802-7052949252dd
Aug 12 16:39:04 devstack sudo[114450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:04 devstack sudo[114446]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.269s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:39:04 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Deleted volume successfully.
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "cinder-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e35da419-6800-44dd-86dd-00eb466b7d1f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-e73b0d44-7e78-4573-a471-b9756ace7ca5-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "cinder-quobyte-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-quobyte-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f" acquired by "delete_volume" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[16448136-42b5-4ad3-8b4e-8c4dd02f7e00]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:04 devstack sudo[114450]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0640c2d6-eb45-4b40-9802-7052949252dd" returned: 0 in 0.265s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5bd5329-f150-44a8-9399-455f235ecdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0640c2d6-eb45-4b40-9802-7052949252dd', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fdcf083-2358-4aef-a7d8-63c7ba732379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:04 devstack sudo[114452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f
Aug 12 16:39:04 devstack sudo[114452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:04 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Volume volume-0640c2d6-eb45-4b40-9802-7052949252dd (0640c2d6-eb45-4b40-9802-7052949252dd): created successfully
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fdcf083-2358-4aef-a7d8-63c7ba732379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Flow 'volume_create_manager' (b76efffa-86f4-4ba0-912a-c0b9aed80889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-246bdbc7-61fc-4789-a5b4-df06a7644241-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:04 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-0d8bf750-c235-466d-aacb-1e070cfe1337 tempest-ProjectReaderTests-1705293535 None] Created volume successfully.
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-246bdbc7-61fc-4789-a5b4-df06a7644241-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-6878aaf0-2235-453f-9f4d-359605a6571c" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-6878aaf0-2235-453f-9f4d-359605a6571c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-246bdbc7-61fc-4789-a5b4-df06a7644241" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-246bdbc7-61fc-4789-a5b4-df06a7644241" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] Deleting offline snapshot 246bdbc7-61fc-4789-a5b4-df06a7644241 of volume 6878aaf0-2235-453f-9f4d-359605a6571c {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] snapshot_file for this snap is: volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0ed13f-2679-4423-975a-4e5b2aba2025]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:04 devstack sudo[114455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241
Aug 12 16:39:04 devstack sudo[114455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:04 devstack sudo[114452]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f" returned: 0 in 0.430s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:04 devstack sudo[114461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f
Aug 12 16:39:04 devstack sudo[114461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:04 devstack sudo[114455]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241" returned: 0 in 0.384s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6878aaf0-2235-453f-9f4d-359605a6571c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:39:04 devstack sudo[114461]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f" returned: 0 in 0.256s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[20425a22-b63b-45b8-839c-208b49124679]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-quobyte-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f" released by "delete_volume" :: held 0.737s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Created reservations ['762648c7-980f-4ca5-96f4-7ea25c6689dd', '518bd535-6d71-4cd5-b09a-89ce3fb7ea96', '2a378b55-893b-4b96-90e1-523aeb86d16f', 'ce3e1df0-3c54-46e5-8abb-73aed24274f3'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:05 devstack sudo[114467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c
Aug 12 16:39:05 devstack sudo[114467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:05 devstack sudo[114469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:39:05 devstack sudo[114469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "cinder-44e531bd-08b9-4102-bc86-d24750b92522-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-44e531bd-08b9-4102-bc86-d24750b92522-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:05 devstack sudo[114469]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:05 devstack sudo[114467]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.286s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c" returned: 0 in 0.445s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:05 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Deleted volume successfully.
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "cinder-quobyte-44e531bd-08b9-4102-bc86-d24750b92522" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:05 devstack sudo[114475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241
Aug 12 16:39:05 devstack sudo[114475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-quobyte-44e531bd-08b9-4102-bc86-d24750b92522" acquired by "delete_volume" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f9cf3d65-5430-4c79-a40a-f9e08ad1b15b tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-5cdeb36f-b9a6-4b49-ac16-f985450a0d5f-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f0f8026-5232-40c8-9e04-42bc984ff683]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44e531bd-08b9-4102-bc86-d24750b92522 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:05 devstack sudo[114477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44e531bd-08b9-4102-bc86-d24750b92522
Aug 12 16:39:05 devstack sudo[114477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:05 devstack sudo[114475]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241" returned: 0 in 0.395s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] Acquiring lock "cinder-0640c2d6-eb45-4b40-9802-7052949252dd-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] Lock "cinder-0640c2d6-eb45-4b40-9802-7052949252dd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:05 devstack sudo[114482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241
Aug 12 16:39:05 devstack sudo[114482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] Acquiring lock "cinder-quobyte-0640c2d6-eb45-4b40-9802-7052949252dd" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] Lock "cinder-quobyte-0640c2d6-eb45-4b40-9802-7052949252dd" acquired by "delete_volume" :: waited 0.020s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:05 devstack sudo[114477]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44e531bd-08b9-4102-bc86-d24750b92522" returned: 0 in 0.428s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44e531bd-08b9-4102-bc86-d24750b92522 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd04f07d-3c4c-4739-b0a1-93d58fe6727e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0640c2d6-eb45-4b40-9802-7052949252dd {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:05 devstack sudo[114487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44e531bd-08b9-4102-bc86-d24750b92522
Aug 12 16:39:05 devstack sudo[114487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:06 devstack sudo[114488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0640c2d6-eb45-4b40-9802-7052949252dd
Aug 12 16:39:06 devstack sudo[114488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:06 devstack sudo[114482]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c.246bdbc7-61fc-4789-a5b4-df06a7644241" returned: 0 in 0.291s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-246bdbc7-61fc-4789-a5b4-df06a7644241" released by "_delete_snapshot" :: held 1.652s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-6878aaf0-2235-453f-9f4d-359605a6571c" released by "delete_snapshot" :: held 1.676s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:06 devstack sudo[114487]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-44e531bd-08b9-4102-bc86-d24750b92522" returned: 0 in 0.255s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-quobyte-44e531bd-08b9-4102-bc86-d24750b92522" released by "delete_volume" :: held 0.752s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] Created reservations ['2dc52d69-02e2-4342-abe7-c0d7956b9c8a', '4a5c5f6c-ae39-482a-a66b-aefa0e72a2e0', '53001453-c69f-4ff5-ad67-31ff4042230e', '63665ec6-c891-4ab7-b6e7-207e942c6c09'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Created reservations ['023bdb41-dd7b-49ac-b9fa-c48c95029e3c', 'cda39e1b-a67f-4f6b-bcfc-d0b562caaa0c', '083e0e72-c0be-4973-b8a6-279a81ed08eb', 'de122fe1-8b8b-495f-ac64-2bae4ecbcbed'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:06 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] Delete snapshot completed successfully.
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0a33b1d3-7234-4141-8440-3937bf43d530 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-246bdbc7-61fc-4789-a5b4-df06a7644241-delete_snapshot" released by "delete_snapshot" :: held 1.874s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:06 devstack sudo[114488]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0640c2d6-eb45-4b40-9802-7052949252dd" returned: 0 in 0.407s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0640c2d6-eb45-4b40-9802-7052949252dd {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:06 devstack sudo[114496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0640c2d6-eb45-4b40-9802-7052949252dd
Aug 12 16:39:06 devstack sudo[114496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:06 devstack sudo[114498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:39:06 devstack sudo[114498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "cinder-6a2c8bf7-f0df-4601-ad32-e35941b3a380-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-6a2c8bf7-f0df-4601-ad32-e35941b3a380-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "cinder-quobyte-6a2c8bf7-f0df-4601-ad32-e35941b3a380" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-quobyte-6a2c8bf7-f0df-4601-ad32-e35941b3a380" acquired by "delete_volume" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-6878aaf0-2235-453f-9f4d-359605a6571c-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:06 devstack sudo[114496]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-0640c2d6-eb45-4b40-9802-7052949252dd" returned: 0 in 0.300s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d307f1-04cd-492a-a53f-787b8d5a3e2a]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6a2c8bf7-f0df-4601-ad32-e35941b3a380 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] Lock "cinder-6878aaf0-2235-453f-9f4d-359605a6571c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] Lock "cinder-quobyte-0640c2d6-eb45-4b40-9802-7052949252dd" released by "delete_volume" :: held 0.794s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-6878aaf0-2235-453f-9f4d-359605a6571c" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:06 devstack sudo[114498]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.362s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:39:06 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Deleted volume successfully.
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-6878aaf0-2235-453f-9f4d-359605a6571c" acquired by "delete_volume" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[778506b5-68eb-4c97-88bd-1f7d61677cd5]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:06 devstack sudo[114501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6a2c8bf7-f0df-4601-ad32-e35941b3a380
Aug 12 16:39:06 devstack sudo[114501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-06e6dbd0-dd6e-45bc-8a45-7c1b5053b931 tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-44e531bd-08b9-4102-bc86-d24750b92522-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] Created reservations ['51fde2bf-e3bf-4ac6-bada-eeb771f90e7d', '070406cc-a7cb-4afc-a3aa-74cfaae2f32f', '099bab40-23dd-4455-b49e-eaec6d430cb9', 'f499c3c2-8b30-47bf-b3ff-09b8de58389b'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:06 devstack sudo[114504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c
Aug 12 16:39:06 devstack sudo[114504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:06 devstack sudo[114506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:39:06 devstack sudo[114506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:07 devstack sudo[114501]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6a2c8bf7-f0df-4601-ad32-e35941b3a380" returned: 0 in 0.449s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6a2c8bf7-f0df-4601-ad32-e35941b3a380 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:07 devstack sudo[114511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6a2c8bf7-f0df-4601-ad32-e35941b3a380
Aug 12 16:39:07 devstack sudo[114511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:07 devstack sudo[114506]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.291s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:39:07 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] Deleted volume successfully.
Aug 12 16:39:07 devstack sudo[114504]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c" returned: 0 in 0.448s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5094a577-5c76-40d2-9388-44a414434fc7 tempest-ProjectReaderTests-1705293535 None] Lock "cinder-0640c2d6-eb45-4b40-9802-7052949252dd-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:07 devstack sudo[114518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c
Aug 12 16:39:07 devstack sudo[114518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:07 devstack sudo[114511]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6a2c8bf7-f0df-4601-ad32-e35941b3a380" returned: 0 in 0.334s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-quobyte-6a2c8bf7-f0df-4601-ad32-e35941b3a380" released by "delete_volume" :: held 0.860s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Created reservations ['d3d93878-4a4a-4832-af4b-460cea002a77', '993a18c2-86db-4248-99e4-ac222055aa62', '590a2285-1b9b-4792-98a2-0fa69373a355', '8bcb090d-3840-431a-97d6-d2b9252c6e6e'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:39:07 devstack sudo[114518]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Flow 'volume_create_manager' (77004ac0-6a88-482a-9713-7a6b789bf91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01242c06-800a-433e-91d4-459daa733aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6878aaf0-2235-453f-9f4d-359605a6571c" returned: 0 in 0.359s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01242c06-800a-433e-91d4-459daa733aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-545585194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4725d4cf-e35f-475f-932d-feba4da594dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b0f0e99635483ebea15d7628018498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:39:08Z,use_quota=True,user_id='7fb2148ba79148259002a82bbe23cc36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bdc6ef5-2ff5-480f-9270-6f0739dc6d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bdc6ef5-2ff5-480f-9270-6f0739dc6d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb4cac3-fc1e-42d8-a8d7-2311deb1611d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adb4cac3-fc1e-42d8-a8d7-2311deb1611d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4725d4cf-e35f-475f-932d-feba4da594dd', 'volume_name': 'volume-4725d4cf-e35f-475f-932d-feba4da594dd', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0b1239-ccda-4742-a06a-08e5604e06bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0b1239-ccda-4742-a06a-08e5604e06bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbc92fd-cb72-4726-8fb7-a011ff57a04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:07 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Volume 4725d4cf-e35f-475f-932d-feba4da594dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4725d4cf-e35f-475f-932d-feba4da594dd', 'volume_size': 1}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-545585194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4725d4cf-e35f-475f-932d-feba4da594dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59b0f0e99635483ebea15d7628018498',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:39:08Z,use_quota=True,user_id='7fb2148ba79148259002a82bbe23cc36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Creating volume 4725d4cf-e35f-475f-932d-feba4da594dd {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:39:07 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4725d4cf-e35f-475f-932d-feba4da594dd 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-6878aaf0-2235-453f-9f4d-359605a6571c" released by "delete_volume" :: held 0.944s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:07 devstack sudo[114522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4725d4cf-e35f-475f-932d-feba4da594dd 1073741824
Aug 12 16:39:07 devstack sudo[114522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] Created reservations ['9ab353f0-d8de-46e5-beea-842c57fceeba', '6832abe6-04c1-493d-a974-9207afe8e7dc', '1b9d8b51-a4a2-493a-9844-f3db2baec0f0', 'fbe25a00-a266-4ef1-9646-d9d3a9406d2f'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:07 devstack sudo[114524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:39:07 devstack sudo[114524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:07 devstack sudo[114526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:39:07 devstack sudo[114526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:08 devstack sudo[114524]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.279s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:08 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:39:08 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Deleted volume successfully.
Aug 12 16:39:08 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-85feef2d-660e-4a7b-af4c-395175367a8f tempest-CreateVolumesFromSourceVolumeTest-2020708587 None] Lock "cinder-6a2c8bf7-f0df-4601-ad32-e35941b3a380-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:08 devstack sudo[114522]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4725d4cf-e35f-475f-932d-feba4da594dd 1073741824" returned: 0 in 0.437s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:08 devstack sudo[114526]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.261s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:08 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:39:08 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] Deleted volume successfully.
Aug 12 16:39:08 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-339c78cc-9cd3-4024-b208-7d5f4154e75f tempest-ProjectMemberTests-1974885304 None] Lock "cinder-6878aaf0-2235-453f-9f4d-359605a6571c-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4725d4cf-e35f-475f-932d-feba4da594dd {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:08 devstack sudo[114533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4725d4cf-e35f-475f-932d-feba4da594dd
Aug 12 16:39:08 devstack sudo[114533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:08 devstack sudo[114533]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4725d4cf-e35f-475f-932d-feba4da594dd" returned: 0 in 0.240s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:08 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:39:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cbc92fd-cb72-4726-8fb7-a011ff57a04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4725d4cf-e35f-475f-932d-feba4da594dd', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cd5836-b8b2-4338-a9b8-0ab56d347cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:08 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Volume volume-4725d4cf-e35f-475f-932d-feba4da594dd (4725d4cf-e35f-475f-932d-feba4da594dd): created successfully
Aug 12 16:39:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60cd5836-b8b2-4338-a9b8-0ab56d347cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:08 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Flow 'volume_create_manager' (77004ac0-6a88-482a-9713-7a6b789bf91c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:39:08 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-b52ae864-1b78-4770-8096-ef6f0eb87654 tempest-ProjectReaderTests-1705293535 None] Created volume successfully.
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Flow 'volume_create_manager' (ac01b9ac-4691-495a-afdd-eff5f7bea19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9dae204-6601-4695-91a3-7605977ab7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9dae204-6601-4695-91a3-7605977ab7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1404498399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43017a9f-6fd5-44b6-987c-a12287740d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f0fddecd2b4bc19bba9332ad6df36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:39:09Z,use_quota=True,user_id='f37e9ccd07084ed58fdecd76f5c57dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476f325b-1ac3-496c-affb-5daa3103f59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476f325b-1ac3-496c-affb-5daa3103f59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f70d923-64fe-462f-9191-5e8c6cbb8ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f70d923-64fe-462f-9191-5e8c6cbb8ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43017a9f-6fd5-44b6-987c-a12287740d4b', 'volume_name': 'volume-43017a9f-6fd5-44b6-987c-a12287740d4b', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e07f932-0644-437e-830f-e17c150240a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e07f932-0644-437e-830f-e17c150240a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a2d5ee-87c4-403c-a0df-0f74a4e4c22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:09 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Volume 43017a9f-6fd5-44b6-987c-a12287740d4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43017a9f-6fd5-44b6-987c-a12287740d4b', 'volume_size': 1}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1404498399',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43017a9f-6fd5-44b6-987c-a12287740d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f0fddecd2b4bc19bba9332ad6df36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:39:09Z,use_quota=True,user_id='f37e9ccd07084ed58fdecd76f5c57dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Creating volume 43017a9f-6fd5-44b6-987c-a12287740d4b {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:39:09 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:09 devstack sudo[114536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b 1073741824
Aug 12 16:39:09 devstack sudo[114536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] Acquiring lock "cinder-4725d4cf-e35f-475f-932d-feba4da594dd-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] Lock "cinder-4725d4cf-e35f-475f-932d-feba4da594dd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] Acquiring lock "cinder-quobyte-4725d4cf-e35f-475f-932d-feba4da594dd" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] Lock "cinder-quobyte-4725d4cf-e35f-475f-932d-feba4da594dd" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cab1787-e9ae-48db-b9c3-970555d3202d]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4725d4cf-e35f-475f-932d-feba4da594dd {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:09 devstack sudo[114541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4725d4cf-e35f-475f-932d-feba4da594dd
Aug 12 16:39:09 devstack sudo[114541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:09 devstack sudo[114536]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b 1073741824" returned: 0 in 0.529s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:10 devstack sudo[114544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b
Aug 12 16:39:10 devstack sudo[114544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:10 devstack sudo[114541]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4725d4cf-e35f-475f-932d-feba4da594dd" returned: 0 in 0.441s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4725d4cf-e35f-475f-932d-feba4da594dd {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:10 devstack sudo[114549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4725d4cf-e35f-475f-932d-feba4da594dd
Aug 12 16:39:10 devstack sudo[114549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:10 devstack sudo[114544]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b" returned: 0 in 0.284s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a2d5ee-87c4-403c-a0df-0f74a4e4c22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43017a9f-6fd5-44b6-987c-a12287740d4b', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a88de3-2749-4828-8950-19e5389e0eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:10 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Volume volume-43017a9f-6fd5-44b6-987c-a12287740d4b (43017a9f-6fd5-44b6-987c-a12287740d4b): created successfully
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a88de3-2749-4828-8950-19e5389e0eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Flow 'volume_create_manager' (ac01b9ac-4691-495a-afdd-eff5f7bea19e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:39:10 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-12f4584f-94c0-4165-8543-1570989f6c2a tempest-ProjectMemberTests-1974885304 None] Created volume successfully.
Aug 12 16:39:10 devstack sudo[114549]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4725d4cf-e35f-475f-932d-feba4da594dd" returned: 0 in 0.290s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] Lock "cinder-quobyte-4725d4cf-e35f-475f-932d-feba4da594dd" released by "delete_volume" :: held 0.771s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] Created reservations ['a35795e4-443c-47fa-9326-d9393438272d', 'dee231fe-3d9f-4a4f-af50-115e051c7e5d', '0f7552cc-cec7-41ff-a1de-abf0c1a97a19', '4702d313-45ba-4fc9-b7aa-cf18574f5eaf'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:10 devstack sudo[114554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:39:10 devstack sudo[114554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:10 devstack sudo[114554]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.254s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:39:10 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] Deleted volume successfully.
Aug 12 16:39:10 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-82052a7b-2e6d-41ec-8696-6eb575d15de5 tempest-ProjectReaderTests-1705293535 None] Lock "cinder-4725d4cf-e35f-475f-932d-feba4da594dd-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ca6a397a-3f8e-472c-965d-e5eaddec96af tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ca6a397a-3f8e-472c-965d-e5eaddec96af tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-ca6a397a-3f8e-472c-965d-e5eaddec96af tempest-ProjectMemberTests-1974885304 None] Creating offline snapshot d6007d51-09c6-44d6-983b-192de5484e2d of volume 43017a9f-6fd5-44b6-987c-a12287740d4b {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:39:11 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d760bf-8e02-4241-9940-63c418ad41ae]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca6a397a-3f8e-472c-965d-e5eaddec96af tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:11 devstack sudo[114559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b
Aug 12 16:39:11 devstack sudo[114559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:12 devstack sudo[114559]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca6a397a-3f8e-472c-965d-e5eaddec96af tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b" returned: 0 in 0.431s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca6a397a-3f8e-472c-965d-e5eaddec96af tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:12 devstack sudo[114564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d 1G
Aug 12 16:39:12 devstack sudo[114564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:12 devstack sudo[114564]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca6a397a-3f8e-472c-965d-e5eaddec96af tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d 1G" returned: 0 in 0.538s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca6a397a-3f8e-472c-965d-e5eaddec96af tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43017a9f-6fd5-44b6-987c-a12287740d4b -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:12 devstack sudo[114569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43017a9f-6fd5-44b6-987c-a12287740d4b -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d
Aug 12 16:39:12 devstack sudo[114569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:13 devstack sudo[114569]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca6a397a-3f8e-472c-965d-e5eaddec96af tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43017a9f-6fd5-44b6-987c-a12287740d4b -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d" returned: 0 in 0.316s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:13 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-ca6a397a-3f8e-472c-965d-e5eaddec96af tempest-ProjectMemberTests-1974885304 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d is being set with open permissions: ugo+rw
Aug 12 16:39:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca6a397a-3f8e-472c-965d-e5eaddec96af tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:13 devstack sudo[114574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d
Aug 12 16:39:13 devstack sudo[114574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:13 devstack sudo[114574]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca6a397a-3f8e-472c-965d-e5eaddec96af tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d" returned: 0 in 0.247s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca6a397a-3f8e-472c-965d-e5eaddec96af tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:13 devstack sudo[114577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.info
Aug 12 16:39:13 devstack sudo[114577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:13 devstack sudo[114577]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca6a397a-3f8e-472c-965d-e5eaddec96af tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.info" returned: 0 in 0.256s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:13 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-ca6a397a-3f8e-472c-965d-e5eaddec96af tempest-ProjectMemberTests-1974885304 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.info is being set with open permissions: ugo+rw
Aug 12 16:39:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca6a397a-3f8e-472c-965d-e5eaddec96af tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:13 devstack sudo[114580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.info
Aug 12 16:39:13 devstack sudo[114580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:13 devstack sudo[114580]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ca6a397a-3f8e-472c-965d-e5eaddec96af tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.info" returned: 0 in 0.270s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ca6a397a-3f8e-472c-965d-e5eaddec96af tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.160s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:13 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ca6a397a-3f8e-472c-965d-e5eaddec96af tempest-ProjectMemberTests-1974885304 None] Create snapshot completed successfully
Aug 12 16:39:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-d6007d51-09c6-44d6-983b-192de5484e2d-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-d6007d51-09c6-44d6-983b-192de5484e2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-43017a9f-6fd5-44b6-987c-a12287740d4b" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-43017a9f-6fd5-44b6-987c-a12287740d4b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-d6007d51-09c6-44d6-983b-192de5484e2d" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-d6007d51-09c6-44d6-983b-192de5484e2d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] Deleting offline snapshot d6007d51-09c6-44d6-983b-192de5484e2d of volume 43017a9f-6fd5-44b6-987c-a12287740d4b {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:39:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] snapshot_file for this snap is: volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:39:14 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1347db-7e6c-478f-86e0-8759d0e0266a]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:15 devstack sudo[114583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d
Aug 12 16:39:15 devstack sudo[114583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:15 devstack sudo[114583]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d" returned: 0 in 0.391s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43017a9f-6fd5-44b6-987c-a12287740d4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:39:15 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b371cb5-c4fc-44ea-991e-c54ac63f8783]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:15 devstack sudo[114588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b
Aug 12 16:39:15 devstack sudo[114588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:15 devstack sudo[114588]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b" returned: 0 in 0.372s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:15 devstack sudo[114593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d
Aug 12 16:39:15 devstack sudo[114593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:16 devstack sudo[114593]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d" returned: 0 in 0.412s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:16 devstack sudo[114599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d
Aug 12 16:39:16 devstack sudo[114599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:16 devstack sudo[114599]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b.d6007d51-09c6-44d6-983b-192de5484e2d" returned: 0 in 0.276s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-d6007d51-09c6-44d6-983b-192de5484e2d" released by "_delete_snapshot" :: held 1.583s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-43017a9f-6fd5-44b6-987c-a12287740d4b" released by "delete_snapshot" :: held 1.615s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:16 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] Created reservations ['42cd2c12-528e-44db-8064-8b18fc40eac1', '490f7b06-3895-4763-86da-87e744d576ed', '12f54f15-c100-4e81-8582-8fa49879201d', '8db3cf56-7fad-44ab-a224-6a9e91445ede'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:16 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] Delete snapshot completed successfully.
Aug 12 16:39:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0ae0d203-162d-43d6-95c5-2f033d6ed302 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-d6007d51-09c6-44d6-983b-192de5484e2d-delete_snapshot" released by "delete_snapshot" :: held 1.776s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-43017a9f-6fd5-44b6-987c-a12287740d4b-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-43017a9f-6fd5-44b6-987c-a12287740d4b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-43017a9f-6fd5-44b6-987c-a12287740d4b" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-43017a9f-6fd5-44b6-987c-a12287740d4b" acquired by "delete_volume" :: waited 0.029s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:17 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[b231d989-ba25-49f7-b11a-3c1e5cad19c2]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:17 devstack sudo[114602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b
Aug 12 16:39:17 devstack sudo[114602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:17 devstack sudo[114602]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b" returned: 0 in 0.470s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:17 devstack sudo[114607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b
Aug 12 16:39:17 devstack sudo[114607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:18 devstack sudo[114607]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-43017a9f-6fd5-44b6-987c-a12287740d4b" returned: 0 in 0.281s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-43017a9f-6fd5-44b6-987c-a12287740d4b" released by "delete_volume" :: held 0.825s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] Created reservations ['cf5133c9-327b-4d66-a5fe-ac25f65ebd72', 'c3775c63-b31a-4ca0-9cda-1efad5eaa887', '59bde4f2-4685-4c6f-9721-d77182a3ecad', 'e80a0c59-d58d-4015-b7ed-d888b9a6012a'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:18 devstack sudo[114610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:39:18 devstack sudo[114610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:18 devstack sudo[114610]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.276s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:39:18 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] Deleted volume successfully.
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dae84b47-0053-4cbf-af1f-453c5a6964a9 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-43017a9f-6fd5-44b6-987c-a12287740d4b-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Flow 'volume_create_manager' (68403492-9332-437d-906b-8d2460a1cd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c72ef52-038c-40f6-af90-8c33afe66241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c72ef52-038c-40f6-af90-8c33afe66241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-185897952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c925186-cc56-4c77-a980-915c71cfd664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f0fddecd2b4bc19bba9332ad6df36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:39:19Z,use_quota=True,user_id='f37e9ccd07084ed58fdecd76f5c57dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1679ac-155c-4f34-ac62-f3bc1d88f1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1679ac-155c-4f34-ac62-f3bc1d88f1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107419e4-e7c1-4f86-ac23-262f8d7b6a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107419e4-e7c1-4f86-ac23-262f8d7b6a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c925186-cc56-4c77-a980-915c71cfd664', 'volume_name': 'volume-6c925186-cc56-4c77-a980-915c71cfd664', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2e94b8-88aa-4764-a50c-17509870d7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2e94b8-88aa-4764-a50c-17509870d7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f80803e-c47a-4769-a7d9-a427781f1d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:18 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Volume 6c925186-cc56-4c77-a980-915c71cfd664: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c925186-cc56-4c77-a980-915c71cfd664', 'volume_size': 1}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-185897952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c925186-cc56-4c77-a980-915c71cfd664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f0fddecd2b4bc19bba9332ad6df36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:39:19Z,use_quota=True,user_id='f37e9ccd07084ed58fdecd76f5c57dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Creating volume 6c925186-cc56-4c77-a980-915c71cfd664 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:39:18 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:39:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:18 devstack sudo[114613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664 1073741824
Aug 12 16:39:18 devstack sudo[114613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:19 devstack sudo[114613]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664 1073741824" returned: 0 in 0.434s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:19 devstack sudo[114619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664
Aug 12 16:39:19 devstack sudo[114619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:19 devstack sudo[114621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:39:19 devstack sudo[114621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:19 devstack sudo[114619]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664" returned: 0 in 0.262s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f80803e-c47a-4769-a7d9-a427781f1d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c925186-cc56-4c77-a980-915c71cfd664', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a627d9-28c5-490a-8f43-42f626e5b77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:19 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Volume volume-6c925186-cc56-4c77-a980-915c71cfd664 (6c925186-cc56-4c77-a980-915c71cfd664): created successfully
Aug 12 16:39:19 devstack sudo[114621]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00a627d9-28c5-490a-8f43-42f626e5b77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Flow 'volume_create_manager' (68403492-9332-437d-906b-8d2460a1cd76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.265s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 29 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:39:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>, <Thread(Rabbit-heartbeat, started daemon 134532925736384)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:39:19 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-64c2c19b-1fe3-4503-8206-a6e9ffeefe11 tempest-ProjectMemberTests-1974885304 None] Created volume successfully.
Aug 12 16:39:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-37f6380a-843d-4c3c-a580-1b7e1a87877d tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-37f6380a-843d-4c3c-a580-1b7e1a87877d tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:20 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-37f6380a-843d-4c3c-a580-1b7e1a87877d tempest-ProjectMemberTests-1974885304 None] Creating offline snapshot 5595dda2-8ec2-4a09-9baa-1dea55e91f37 of volume 6c925186-cc56-4c77-a980-915c71cfd664 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:39:20 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[533c1230-2978-452f-b386-bd024987072e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-37f6380a-843d-4c3c-a580-1b7e1a87877d tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:20 devstack sudo[114625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664
Aug 12 16:39:20 devstack sudo[114625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:20 devstack sudo[114625]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-37f6380a-843d-4c3c-a580-1b7e1a87877d tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664" returned: 0 in 0.385s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-37f6380a-843d-4c3c-a580-1b7e1a87877d tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:20 devstack sudo[114631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37 1G
Aug 12 16:39:20 devstack sudo[114631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:20 devstack sudo[114631]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-37f6380a-843d-4c3c-a580-1b7e1a87877d tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37 1G" returned: 0 in 0.413s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-37f6380a-843d-4c3c-a580-1b7e1a87877d tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c925186-cc56-4c77-a980-915c71cfd664 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:20 devstack sudo[114637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c925186-cc56-4c77-a980-915c71cfd664 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37
Aug 12 16:39:20 devstack sudo[114637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:21 devstack sudo[114637]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-37f6380a-843d-4c3c-a580-1b7e1a87877d tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c925186-cc56-4c77-a980-915c71cfd664 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37" returned: 0 in 0.308s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:21 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-37f6380a-843d-4c3c-a580-1b7e1a87877d tempest-ProjectMemberTests-1974885304 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37 is being set with open permissions: ugo+rw
Aug 12 16:39:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-37f6380a-843d-4c3c-a580-1b7e1a87877d tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:21 devstack sudo[114643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37
Aug 12 16:39:21 devstack sudo[114643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:21 devstack sudo[114643]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-37f6380a-843d-4c3c-a580-1b7e1a87877d tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37" returned: 0 in 0.261s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-37f6380a-843d-4c3c-a580-1b7e1a87877d tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:21 devstack sudo[114646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.info
Aug 12 16:39:21 devstack sudo[114646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:21 devstack sudo[114646]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-37f6380a-843d-4c3c-a580-1b7e1a87877d tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.info" returned: 0 in 0.258s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:21 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-37f6380a-843d-4c3c-a580-1b7e1a87877d tempest-ProjectMemberTests-1974885304 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.info is being set with open permissions: ugo+rw
Aug 12 16:39:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-37f6380a-843d-4c3c-a580-1b7e1a87877d tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:21 devstack sudo[114649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.info
Aug 12 16:39:21 devstack sudo[114649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:21 devstack sudo[114649]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-37f6380a-843d-4c3c-a580-1b7e1a87877d tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.info" returned: 0 in 0.240s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-37f6380a-843d-4c3c-a580-1b7e1a87877d tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.950s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:22 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-37f6380a-843d-4c3c-a580-1b7e1a87877d tempest-ProjectMemberTests-1974885304 None] Create snapshot completed successfully
Aug 12 16:39:22 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-5595dda2-8ec2-4a09-9baa-1dea55e91f37-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:22 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-5595dda2-8ec2-4a09-9baa-1dea55e91f37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:22 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-6c925186-cc56-4c77-a980-915c71cfd664" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:22 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-6c925186-cc56-4c77-a980-915c71cfd664" acquired by "delete_snapshot" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:22 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-5595dda2-8ec2-4a09-9baa-1dea55e91f37" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:22 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-5595dda2-8ec2-4a09-9baa-1dea55e91f37" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] Deleting offline snapshot 5595dda2-8ec2-4a09-9baa-1dea55e91f37 of volume 6c925186-cc56-4c77-a980-915c71cfd664 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:39:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] snapshot_file for this snap is: volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:39:22 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bca25f4-d135-497a-97d8-961165bc109f]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:22 devstack sudo[114652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37
Aug 12 16:39:22 devstack sudo[114652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:22 devstack sudo[114652]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37" returned: 0 in 0.395s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c925186-cc56-4c77-a980-915c71cfd664(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:39:22 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50a398c-45ca-419a-8825-672559d9ae5f]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:22 devstack sudo[114657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664
Aug 12 16:39:22 devstack sudo[114657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:23 devstack sudo[114657]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664" returned: 0 in 0.397s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:23 devstack sudo[114663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37
Aug 12 16:39:23 devstack sudo[114663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:23 devstack sudo[114663]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37" returned: 0 in 0.341s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:23 devstack sudo[114668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37
Aug 12 16:39:23 devstack sudo[114668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:23 devstack sudo[114668]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664.5595dda2-8ec2-4a09-9baa-1dea55e91f37" returned: 0 in 0.245s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-5595dda2-8ec2-4a09-9baa-1dea55e91f37" released by "_delete_snapshot" :: held 1.489s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-6c925186-cc56-4c77-a980-915c71cfd664" released by "delete_snapshot" :: held 1.518s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:23 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] Created reservations ['d7a54936-6155-4624-b2c4-29a7ec165b8d', '0c7eac72-0833-4b60-8917-b6f8e57111df', '313fa790-48a3-4156-b165-8534c0284abd', '40e0a273-e435-4b5f-a8fe-520da8e7f918'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:23 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] Delete snapshot completed successfully.
Aug 12 16:39:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-8333ab54-d51a-47d2-a976-2d0dbf899479 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-5595dda2-8ec2-4a09-9baa-1dea55e91f37-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-6c925186-cc56-4c77-a980-915c71cfd664-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-6c925186-cc56-4c77-a980-915c71cfd664-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-6c925186-cc56-4c77-a980-915c71cfd664" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-6c925186-cc56-4c77-a980-915c71cfd664" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:24 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2928574-eb26-41b9-b5ef-68e8fb5aa38f]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:24 devstack sudo[114671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664
Aug 12 16:39:24 devstack sudo[114671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:24 devstack sudo[114671]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664" returned: 0 in 0.350s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:24 devstack sudo[114676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664
Aug 12 16:39:24 devstack sudo[114676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:25 devstack sudo[114676]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-6c925186-cc56-4c77-a980-915c71cfd664" returned: 0 in 0.237s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:25 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-6c925186-cc56-4c77-a980-915c71cfd664" released by "delete_volume" :: held 0.644s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:25 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] Created reservations ['86b9b0e4-b8e0-4210-a034-cc068c6cffef', 'f58ece0d-c4b7-4541-8037-b7e80f296c06', 'ce4e2776-8b8e-47d7-82ef-b9add276d801', '0669feac-c6c8-4711-8da1-f84a8ee251b6'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:25 devstack sudo[114679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:39:25 devstack sudo[114679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:25 devstack sudo[114679]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.239s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:25 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:39:25 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] Deleted volume successfully.
Aug 12 16:39:25 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-90866410-6bb6-4926-9e4b-781636aa6db6 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-6c925186-cc56-4c77-a980-915c71cfd664-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:25 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:39:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Flow 'volume_create_manager' (1341ab20-137b-46d1-9cb6-cdb4e6c4d69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:39:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8d737d-4ac8-49c2-b816-08aaac3ce53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8d737d-4ac8-49c2-b816-08aaac3ce53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1320727529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f0fddecd2b4bc19bba9332ad6df36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:39:26Z,use_quota=True,user_id='f37e9ccd07084ed58fdecd76f5c57dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138b232e-e896-4b40-bb29-550ccface044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (138b232e-e896-4b40-bb29-550ccface044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f6ba9c-b969-477b-b9bb-d04cf1d82395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f6ba9c-b969-477b-b9bb-d04cf1d82395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6', 'volume_name': 'volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624d5555-aa0d-43d9-bff3-650b88c21daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624d5555-aa0d-43d9-bff3-650b88c21daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0e94f9-0323-4ba6-8d4f-9371b53ffff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:26 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Volume 3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6', 'volume_size': 1}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1320727529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f0fddecd2b4bc19bba9332ad6df36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:39:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:39:26Z,use_quota=True,user_id='f37e9ccd07084ed58fdecd76f5c57dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Creating volume 3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:39:26 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:26 devstack sudo[114682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6 1073741824
Aug 12 16:39:26 devstack sudo[114682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:26 devstack sudo[114682]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6 1073741824" returned: 0 in 0.420s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:26 devstack sudo[114687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6
Aug 12 16:39:26 devstack sudo[114687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:26 devstack sudo[114687]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6" returned: 0 in 0.249s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d0e94f9-0323-4ba6-8d4f-9371b53ffff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65d91fe-a20b-4588-ac66-bea8de952a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:26 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Volume volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6 (3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6): created successfully
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65d91fe-a20b-4588-ac66-bea8de952a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Flow 'volume_create_manager' (1341ab20-137b-46d1-9cb6-cdb4e6c4d69d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:39:26 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-54050ea0-cbab-49fb-8b64-f4d284564710 tempest-ProjectMemberTests-1974885304 None] Created volume successfully.
Aug 12 16:39:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-297c0512-cac2-4fd4-aee2-b1780bcd9e4d tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-297c0512-cac2-4fd4-aee2-b1780bcd9e4d tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:27 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-297c0512-cac2-4fd4-aee2-b1780bcd9e4d tempest-ProjectMemberTests-1974885304 None] Creating offline snapshot 2c8d6196-6afd-49ec-b074-e629dfe2a038 of volume 3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:39:27 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[749309d8-f28c-400f-9762-ce5add696c93]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-297c0512-cac2-4fd4-aee2-b1780bcd9e4d tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:27 devstack sudo[114690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6
Aug 12 16:39:27 devstack sudo[114690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:27 devstack sudo[114690]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-297c0512-cac2-4fd4-aee2-b1780bcd9e4d tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6" returned: 0 in 0.352s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-297c0512-cac2-4fd4-aee2-b1780bcd9e4d tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:27 devstack sudo[114695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038 1G
Aug 12 16:39:27 devstack sudo[114695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:27 devstack sudo[114695]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-297c0512-cac2-4fd4-aee2-b1780bcd9e4d tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038 1G" returned: 0 in 0.393s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-297c0512-cac2-4fd4-aee2-b1780bcd9e4d tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:27 devstack sudo[114700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038
Aug 12 16:39:27 devstack sudo[114700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:28 devstack sudo[114700]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-297c0512-cac2-4fd4-aee2-b1780bcd9e4d tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038" returned: 0 in 0.296s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:28 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-297c0512-cac2-4fd4-aee2-b1780bcd9e4d tempest-ProjectMemberTests-1974885304 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038 is being set with open permissions: ugo+rw
Aug 12 16:39:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-297c0512-cac2-4fd4-aee2-b1780bcd9e4d tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:28 devstack sudo[114705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038
Aug 12 16:39:28 devstack sudo[114705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:28 devstack sudo[114705]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-297c0512-cac2-4fd4-aee2-b1780bcd9e4d tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038" returned: 0 in 0.244s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-297c0512-cac2-4fd4-aee2-b1780bcd9e4d tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:28 devstack sudo[114708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.info
Aug 12 16:39:28 devstack sudo[114708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:28 devstack sudo[114708]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-297c0512-cac2-4fd4-aee2-b1780bcd9e4d tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.info" returned: 0 in 0.245s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:28 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-297c0512-cac2-4fd4-aee2-b1780bcd9e4d tempest-ProjectMemberTests-1974885304 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.info is being set with open permissions: ugo+rw
Aug 12 16:39:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-297c0512-cac2-4fd4-aee2-b1780bcd9e4d tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:28 devstack sudo[114711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.info
Aug 12 16:39:28 devstack sudo[114711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:28 devstack sudo[114711]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-297c0512-cac2-4fd4-aee2-b1780bcd9e4d tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.info" returned: 0 in 0.235s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-297c0512-cac2-4fd4-aee2-b1780bcd9e4d tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.840s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:28 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-297c0512-cac2-4fd4-aee2-b1780bcd9e4d tempest-ProjectMemberTests-1974885304 None] Create snapshot completed successfully
Aug 12 16:39:29 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-2c8d6196-6afd-49ec-b074-e629dfe2a038-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:29 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] Lock "cinder-2c8d6196-6afd-49ec-b074-e629dfe2a038-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:29 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:29 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6" acquired by "delete_snapshot" :: waited 0.012s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:29 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-2c8d6196-6afd-49ec-b074-e629dfe2a038" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:29 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-2c8d6196-6afd-49ec-b074-e629dfe2a038" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] Deleting offline snapshot 2c8d6196-6afd-49ec-b074-e629dfe2a038 of volume 3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:39:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] snapshot_file for this snap is: volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:39:29 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1a4e47-f352-41d7-bcb7-34a7ee2dc1ab]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:29 devstack sudo[114714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038
Aug 12 16:39:29 devstack sudo[114714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:29 devstack sudo[114714]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038" returned: 0 in 0.349s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:39:29 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb3fb81-9cf4-4fa9-9e63-c472f25e6a90]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:29 devstack sudo[114719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6
Aug 12 16:39:29 devstack sudo[114719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:30 devstack sudo[114719]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6" returned: 0 in 0.344s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:30 devstack sudo[114724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038
Aug 12 16:39:30 devstack sudo[114724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:30 devstack sudo[114724]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038" returned: 0 in 0.319s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:30 devstack sudo[114729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038
Aug 12 16:39:30 devstack sudo[114729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:30 devstack sudo[114729]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6.2c8d6196-6afd-49ec-b074-e629dfe2a038" returned: 0 in 0.249s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-2c8d6196-6afd-49ec-b074-e629dfe2a038" released by "_delete_snapshot" :: held 1.351s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6" released by "delete_snapshot" :: held 1.371s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:30 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] Created reservations ['eabcd07e-0654-4d24-8566-3782f4f2f7af', '1a35f596-2050-469e-8c02-8d4737f602e4', 'e2b4c95b-0fc1-498c-a167-d13ee602b068', '682dc656-2772-483d-afe0-750ee47421b4'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:30 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] Delete snapshot completed successfully.
Aug 12 16:39:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-c86bb235-c667-4066-a1d3-3266513f86ee tempest-ProjectMemberTests-1974885304 None] Lock "cinder-2c8d6196-6afd-49ec-b074-e629dfe2a038-delete_snapshot" released by "delete_snapshot" :: held 1.505s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] Lock "cinder-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6" acquired by "delete_volume" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:31 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a600f86-efb4-44a2-bcee-bc074167fad5]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:31 devstack sudo[114769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6
Aug 12 16:39:31 devstack sudo[114769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:31 devstack sudo[114769]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6" returned: 0 in 0.353s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:31 devstack sudo[114774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6
Aug 12 16:39:31 devstack sudo[114774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:32 devstack sudo[114774]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6" returned: 0 in 0.244s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6" released by "delete_volume" :: held 0.653s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] Created reservations ['c8d83073-c3b9-45aa-9a58-f2f32ebe3094', 'dbafbe0d-31c7-4ddb-b9a2-86afb1a5dda6', '6b27779f-c64d-47d8-9760-fb0233a6f0ad', 'ab145877-e4a6-4744-beae-5ae09aad1e5d'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:32 devstack sudo[114777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:39:32 devstack sudo[114777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:32 devstack sudo[114777]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.241s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:39:32 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] Deleted volume successfully.
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9a6390c4-745c-42a3-a2be-7590a802c25f tempest-ProjectMemberTests-1974885304 None] Lock "cinder-3e640b9d-a0d7-4404-bcd7-2ca1fa8b08c6-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Flow 'volume_create_manager' (758b502e-626a-4f4a-801a-4bd1c1aace86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5776ce75-dff6-4d4b-8f25-a12e3c066ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5776ce75-dff6-4d4b-8f25-a12e3c066ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1206313984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b928d5e7-72b6-41f9-af4f-0931303b46ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f0fddecd2b4bc19bba9332ad6df36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:39:33Z,use_quota=True,user_id='f37e9ccd07084ed58fdecd76f5c57dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d88e14-fc09-4ed3-b0b1-ff284763cfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04d88e14-fc09-4ed3-b0b1-ff284763cfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d8d102-fad2-4a87-ae1e-ca8c7388cd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d8d102-fad2-4a87-ae1e-ca8c7388cd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b928d5e7-72b6-41f9-af4f-0931303b46ab', 'volume_name': 'volume-b928d5e7-72b6-41f9-af4f-0931303b46ab', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9e5272-9820-4937-8aed-1828176f551f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9e5272-9820-4937-8aed-1828176f551f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f75e3b2-b743-452c-a7bf-25bc4dc380e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:32 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Volume b928d5e7-72b6-41f9-af4f-0931303b46ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b928d5e7-72b6-41f9-af4f-0931303b46ab', 'volume_size': 1}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1206313984',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b928d5e7-72b6-41f9-af4f-0931303b46ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f0fddecd2b4bc19bba9332ad6df36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:39:33Z,use_quota=True,user_id='f37e9ccd07084ed58fdecd76f5c57dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:39:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Creating volume b928d5e7-72b6-41f9-af4f-0931303b46ab {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:39:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:39:33 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:39:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:33 devstack sudo[114780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab 1073741824
Aug 12 16:39:33 devstack sudo[114780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:33 devstack sudo[114780]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab 1073741824" returned: 0 in 0.404s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:33 devstack sudo[114786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab
Aug 12 16:39:33 devstack sudo[114786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:33 devstack sudo[114786]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab" returned: 0 in 0.241s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:39:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f75e3b2-b743-452c-a7bf-25bc4dc380e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b928d5e7-72b6-41f9-af4f-0931303b46ab', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b114ddd-f7b7-49a2-ba46-e3451a347fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:33 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Volume volume-b928d5e7-72b6-41f9-af4f-0931303b46ab (b928d5e7-72b6-41f9-af4f-0931303b46ab): created successfully
Aug 12 16:39:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b114ddd-f7b7-49a2-ba46-e3451a347fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Flow 'volume_create_manager' (758b502e-626a-4f4a-801a-4bd1c1aace86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:39:33 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-26aefaa2-040b-4541-a241-919737397f90 tempest-ProjectMemberTests-1974885304 None] Created volume successfully.
Aug 12 16:39:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-961919a8-5eb7-4c5f-883b-f07c0b8c0673 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-961919a8-5eb7-4c5f-883b-f07c0b8c0673 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:34 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-961919a8-5eb7-4c5f-883b-f07c0b8c0673 tempest-ProjectMemberTests-1974885304 None] Creating offline snapshot a0fab237-418d-48e7-b0c0-f6af20556f6a of volume b928d5e7-72b6-41f9-af4f-0931303b46ab {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:39:34 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[733bd678-0b60-48eb-a60a-6c7c4250fba6]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-961919a8-5eb7-4c5f-883b-f07c0b8c0673 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:34 devstack sudo[114795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab
Aug 12 16:39:34 devstack sudo[114795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:34 devstack sudo[114795]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-961919a8-5eb7-4c5f-883b-f07c0b8c0673 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab" returned: 0 in 0.362s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-961919a8-5eb7-4c5f-883b-f07c0b8c0673 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:34 devstack sudo[114800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a 1G
Aug 12 16:39:34 devstack sudo[114800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:34 devstack sudo[114800]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-961919a8-5eb7-4c5f-883b-f07c0b8c0673 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a 1G" returned: 0 in 0.396s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-961919a8-5eb7-4c5f-883b-f07c0b8c0673 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b928d5e7-72b6-41f9-af4f-0931303b46ab -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:34 devstack sudo[114806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b928d5e7-72b6-41f9-af4f-0931303b46ab -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a
Aug 12 16:39:34 devstack sudo[114806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:35 devstack sudo[114806]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-961919a8-5eb7-4c5f-883b-f07c0b8c0673 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b928d5e7-72b6-41f9-af4f-0931303b46ab -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a" returned: 0 in 0.275s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:35 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-961919a8-5eb7-4c5f-883b-f07c0b8c0673 tempest-ProjectMemberTests-1974885304 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a is being set with open permissions: ugo+rw
Aug 12 16:39:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-961919a8-5eb7-4c5f-883b-f07c0b8c0673 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:35 devstack sudo[114811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a
Aug 12 16:39:35 devstack sudo[114811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:35 devstack sudo[114811]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-961919a8-5eb7-4c5f-883b-f07c0b8c0673 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a" returned: 0 in 0.240s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-961919a8-5eb7-4c5f-883b-f07c0b8c0673 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:35 devstack sudo[114814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.info
Aug 12 16:39:35 devstack sudo[114814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:35 devstack sudo[114814]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-961919a8-5eb7-4c5f-883b-f07c0b8c0673 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.info" returned: 0 in 0.254s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:35 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-961919a8-5eb7-4c5f-883b-f07c0b8c0673 tempest-ProjectMemberTests-1974885304 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.info is being set with open permissions: ugo+rw
Aug 12 16:39:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-961919a8-5eb7-4c5f-883b-f07c0b8c0673 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:35 devstack sudo[114817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.info
Aug 12 16:39:35 devstack sudo[114817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:35 devstack sudo[114817]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-961919a8-5eb7-4c5f-883b-f07c0b8c0673 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.info" returned: 0 in 0.240s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-961919a8-5eb7-4c5f-883b-f07c0b8c0673 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:35 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-961919a8-5eb7-4c5f-883b-f07c0b8c0673 tempest-ProjectMemberTests-1974885304 None] Create snapshot completed successfully
Aug 12 16:39:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-a0fab237-418d-48e7-b0c0-f6af20556f6a-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-a0fab237-418d-48e7-b0c0-f6af20556f6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-b928d5e7-72b6-41f9-af4f-0931303b46ab" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-b928d5e7-72b6-41f9-af4f-0931303b46ab" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-a0fab237-418d-48e7-b0c0-f6af20556f6a" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:36 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-a0fab237-418d-48e7-b0c0-f6af20556f6a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] Deleting offline snapshot a0fab237-418d-48e7-b0c0-f6af20556f6a of volume b928d5e7-72b6-41f9-af4f-0931303b46ab {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:39:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] snapshot_file for this snap is: volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:39:36 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c2e0cf-1a12-4dfd-97fc-998b5146367d]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:36 devstack sudo[114820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a
Aug 12 16:39:36 devstack sudo[114820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:36 devstack sudo[114820]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a" returned: 0 in 0.355s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b928d5e7-72b6-41f9-af4f-0931303b46ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:39:36 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66dbec1-aebe-440c-ba5b-7ca2831604ac]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:36 devstack sudo[114825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab
Aug 12 16:39:36 devstack sudo[114825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:37 devstack sudo[114825]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab" returned: 0 in 0.344s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:37 devstack sudo[114830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a
Aug 12 16:39:37 devstack sudo[114830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:37 devstack sudo[114830]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a" returned: 0 in 0.335s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:37 devstack sudo[114835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a
Aug 12 16:39:37 devstack sudo[114835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:37 devstack sudo[114835]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab.a0fab237-418d-48e7-b0c0-f6af20556f6a" returned: 0 in 0.241s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-a0fab237-418d-48e7-b0c0-f6af20556f6a" released by "_delete_snapshot" :: held 1.362s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-b928d5e7-72b6-41f9-af4f-0931303b46ab" released by "delete_snapshot" :: held 1.385s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:37 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] Created reservations ['6ca6ba1b-5292-4736-871a-7e1e4f8223f7', 'e4581d3e-29fa-44d2-a2e7-b8fbb8708eb6', '8be6f747-bdcc-4086-802b-c715edb9aa6a', 'f1a8ded9-8765-4822-8043-ce1d63993c4f'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:37 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] Delete snapshot completed successfully.
Aug 12 16:39:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4fac097a-dc77-4be5-b145-fc16698040d2 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-a0fab237-418d-48e7-b0c0-f6af20556f6a-delete_snapshot" released by "delete_snapshot" :: held 1.511s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-b928d5e7-72b6-41f9-af4f-0931303b46ab-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] Lock "cinder-b928d5e7-72b6-41f9-af4f-0931303b46ab-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-b928d5e7-72b6-41f9-af4f-0931303b46ab" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-b928d5e7-72b6-41f9-af4f-0931303b46ab" acquired by "delete_volume" :: waited 0.013s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:38 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d58ea6-5a8e-4efd-81fd-5a21553a4a19]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:38 devstack sudo[114839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab
Aug 12 16:39:38 devstack sudo[114839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:38 devstack sudo[114839]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab" returned: 0 in 0.347s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:38 devstack sudo[114844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab
Aug 12 16:39:38 devstack sudo[114844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:39 devstack sudo[114844]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-b928d5e7-72b6-41f9-af4f-0931303b46ab" returned: 0 in 0.244s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-b928d5e7-72b6-41f9-af4f-0931303b46ab" released by "delete_volume" :: held 0.645s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] Created reservations ['f0bdadb1-8473-4cf8-9567-bae7955ef82b', 'd99f83ae-4d1e-4bf2-b6ad-bde99324a35c', '9b79c31e-f03d-4d88-a1c2-86bdb184fc55', 'fec4530b-455f-4b06-8294-047aad56ac40'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:39 devstack sudo[114847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:39:39 devstack sudo[114847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:39 devstack sudo[114847]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.236s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:39:39 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] Deleted volume successfully.
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-1af59ec1-9230-415f-b3c3-0eb047c0b02a tempest-ProjectMemberTests-1974885304 None] Lock "cinder-b928d5e7-72b6-41f9-af4f-0931303b46ab-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Flow 'volume_create_manager' (80794195-3bf1-461e-93d3-0336891f1c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a87d014-892b-4006-b1d5-1495e110491d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a87d014-892b-4006-b1d5-1495e110491d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-365817589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfefe4e0-ca55-4929-90c1-8c307874473a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f0fddecd2b4bc19bba9332ad6df36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:39:40Z,use_quota=True,user_id='f37e9ccd07084ed58fdecd76f5c57dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4537239d-650a-4b56-978d-17ab2e4d132d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4537239d-650a-4b56-978d-17ab2e4d132d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432c297f-10d7-4ee8-9268-e1691b0c15b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (432c297f-10d7-4ee8-9268-e1691b0c15b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfefe4e0-ca55-4929-90c1-8c307874473a', 'volume_name': 'volume-cfefe4e0-ca55-4929-90c1-8c307874473a', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79fca7c-e8e6-4e7e-a96d-3e88876a95c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e79fca7c-e8e6-4e7e-a96d-3e88876a95c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af57b21-1135-4d1c-a91e-b41389bc3459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:40 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Volume cfefe4e0-ca55-4929-90c1-8c307874473a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfefe4e0-ca55-4929-90c1-8c307874473a', 'volume_size': 1}
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:39:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-365817589',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfefe4e0-ca55-4929-90c1-8c307874473a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f0fddecd2b4bc19bba9332ad6df36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:39:40Z,use_quota=True,user_id='f37e9ccd07084ed58fdecd76f5c57dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Creating volume cfefe4e0-ca55-4929-90c1-8c307874473a {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:39:40 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:40 devstack sudo[114850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a 1073741824
Aug 12 16:39:40 devstack sudo[114850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:40 devstack sudo[114850]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a 1073741824" returned: 0 in 0.408s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:40 devstack sudo[114857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a
Aug 12 16:39:40 devstack sudo[114857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:40 devstack sudo[114857]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a" returned: 0 in 0.248s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9af57b21-1135-4d1c-a91e-b41389bc3459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfefe4e0-ca55-4929-90c1-8c307874473a', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a9ae14-0867-40db-983c-f6d048e348ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:40 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Volume volume-cfefe4e0-ca55-4929-90c1-8c307874473a (cfefe4e0-ca55-4929-90c1-8c307874473a): created successfully
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a9ae14-0867-40db-983c-f6d048e348ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Flow 'volume_create_manager' (80794195-3bf1-461e-93d3-0336891f1c27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:39:40 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-453f469e-56a7-46e4-8597-14bde192fc76 tempest-ProjectMemberTests-1974885304 None] Created volume successfully.
Aug 12 16:39:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-eeccbc0b-9202-4dcc-a70d-09868d8f863e tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-eeccbc0b-9202-4dcc-a70d-09868d8f863e tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:41 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-eeccbc0b-9202-4dcc-a70d-09868d8f863e tempest-ProjectMemberTests-1974885304 None] Creating offline snapshot 2b2ecd26-d399-4be5-a2b8-6a767a3abb59 of volume cfefe4e0-ca55-4929-90c1-8c307874473a {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:39:41 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bf5e87-36d1-4143-bbc4-d669e2044a3b]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-eeccbc0b-9202-4dcc-a70d-09868d8f863e tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:41 devstack sudo[114862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a
Aug 12 16:39:41 devstack sudo[114862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:41 devstack sudo[114862]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-eeccbc0b-9202-4dcc-a70d-09868d8f863e tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a" returned: 0 in 0.354s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-eeccbc0b-9202-4dcc-a70d-09868d8f863e tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:41 devstack sudo[114867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59 1G
Aug 12 16:39:41 devstack sudo[114867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:41 devstack sudo[114867]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-eeccbc0b-9202-4dcc-a70d-09868d8f863e tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59 1G" returned: 0 in 0.383s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-eeccbc0b-9202-4dcc-a70d-09868d8f863e tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfefe4e0-ca55-4929-90c1-8c307874473a -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:41 devstack sudo[114873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfefe4e0-ca55-4929-90c1-8c307874473a -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59
Aug 12 16:39:41 devstack sudo[114873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:42 devstack sudo[114873]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-eeccbc0b-9202-4dcc-a70d-09868d8f863e tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfefe4e0-ca55-4929-90c1-8c307874473a -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59" returned: 0 in 0.288s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:42 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-eeccbc0b-9202-4dcc-a70d-09868d8f863e tempest-ProjectMemberTests-1974885304 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59 is being set with open permissions: ugo+rw
Aug 12 16:39:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-eeccbc0b-9202-4dcc-a70d-09868d8f863e tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:42 devstack sudo[114878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59
Aug 12 16:39:42 devstack sudo[114878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:42 devstack sudo[114878]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-eeccbc0b-9202-4dcc-a70d-09868d8f863e tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59" returned: 0 in 0.233s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-eeccbc0b-9202-4dcc-a70d-09868d8f863e tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:42 devstack sudo[114881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.info
Aug 12 16:39:42 devstack sudo[114881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:42 devstack sudo[114881]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-eeccbc0b-9202-4dcc-a70d-09868d8f863e tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.info" returned: 0 in 0.244s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:42 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-eeccbc0b-9202-4dcc-a70d-09868d8f863e tempest-ProjectMemberTests-1974885304 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.info is being set with open permissions: ugo+rw
Aug 12 16:39:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-eeccbc0b-9202-4dcc-a70d-09868d8f863e tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:42 devstack sudo[114884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.info
Aug 12 16:39:42 devstack sudo[114884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:42 devstack sudo[114884]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-eeccbc0b-9202-4dcc-a70d-09868d8f863e tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.info" returned: 0 in 0.242s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-eeccbc0b-9202-4dcc-a70d-09868d8f863e tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.822s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:42 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-eeccbc0b-9202-4dcc-a70d-09868d8f863e tempest-ProjectMemberTests-1974885304 None] Create snapshot completed successfully
Aug 12 16:39:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-2b2ecd26-d399-4be5-a2b8-6a767a3abb59-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-2b2ecd26-d399-4be5-a2b8-6a767a3abb59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-cfefe4e0-ca55-4929-90c1-8c307874473a" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-cfefe4e0-ca55-4929-90c1-8c307874473a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-2b2ecd26-d399-4be5-a2b8-6a767a3abb59" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:43 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-2b2ecd26-d399-4be5-a2b8-6a767a3abb59" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:43 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] Deleting offline snapshot 2b2ecd26-d399-4be5-a2b8-6a767a3abb59 of volume cfefe4e0-ca55-4929-90c1-8c307874473a {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:39:43 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] snapshot_file for this snap is: volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:39:43 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d09ae7-1433-4c69-9b90-dfc2a02c4225]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:43 devstack sudo[114887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59
Aug 12 16:39:43 devstack sudo[114887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:43 devstack sudo[114887]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59" returned: 0 in 0.353s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:43 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfefe4e0-ca55-4929-90c1-8c307874473a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:39:43 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4accc06-ba5f-4342-961c-c390cf074667]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:43 devstack sudo[114892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a
Aug 12 16:39:43 devstack sudo[114892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:44 devstack sudo[114892]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a" returned: 0 in 0.343s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:44 devstack sudo[114897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59
Aug 12 16:39:44 devstack sudo[114897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:44 devstack sudo[114897]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59" returned: 0 in 0.325s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:44 devstack sudo[114902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59
Aug 12 16:39:44 devstack sudo[114902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:44 devstack sudo[114902]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a.2b2ecd26-d399-4be5-a2b8-6a767a3abb59" returned: 0 in 0.243s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-2b2ecd26-d399-4be5-a2b8-6a767a3abb59" released by "_delete_snapshot" :: held 1.355s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-cfefe4e0-ca55-4929-90c1-8c307874473a" released by "delete_snapshot" :: held 1.378s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:44 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] Created reservations ['33100bbe-f159-4f9a-8edf-b95f5931e198', '6f585faf-c4ac-45d1-8187-0497ec777610', '940ac600-a0bf-4306-be50-d116f37c4143', '29c40df9-7901-402f-a1cb-b5b5453f2da7'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:44 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] Delete snapshot completed successfully.
Aug 12 16:39:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-257b1c1a-8516-487d-a013-8df8efd885a7 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-2b2ecd26-d399-4be5-a2b8-6a767a3abb59-delete_snapshot" released by "delete_snapshot" :: held 1.499s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-cfefe4e0-ca55-4929-90c1-8c307874473a-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] Lock "cinder-cfefe4e0-ca55-4929-90c1-8c307874473a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-cfefe4e0-ca55-4929-90c1-8c307874473a" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-cfefe4e0-ca55-4929-90c1-8c307874473a" acquired by "delete_volume" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:45 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9ca5d6-263d-4a26-8741-ec784bcc9e22]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:45 devstack sudo[114905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a
Aug 12 16:39:45 devstack sudo[114905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:45 devstack sudo[114905]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a" returned: 0 in 0.348s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:45 devstack sudo[114910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a
Aug 12 16:39:45 devstack sudo[114910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:46 devstack sudo[114910]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-cfefe4e0-ca55-4929-90c1-8c307874473a" returned: 0 in 0.241s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-cfefe4e0-ca55-4929-90c1-8c307874473a" released by "delete_volume" :: held 0.645s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] Created reservations ['d6f147fd-14cc-445b-9141-1fa2826a7bd3', '1996262a-b123-4885-a1a8-21214c71d169', 'f1356f15-cdf9-41c0-a8cb-e7c55f54e67d', '57a7e43f-b6f2-4ba8-9262-535ea0a8300f'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:46 devstack sudo[114913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:39:46 devstack sudo[114913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:46 devstack sudo[114913]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.245s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:39:46 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] Deleted volume successfully.
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-ab237c91-58b8-481e-956f-cdbe98f3407a tempest-ProjectMemberTests-1974885304 None] Lock "cinder-cfefe4e0-ca55-4929-90c1-8c307874473a-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Flow 'volume_create_manager' (2e461b2a-5f51-4f63-ba37-2f8f60e10be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b19730-0b9c-4443-b648-09ddbee66a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8b19730-0b9c-4443-b648-09ddbee66a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1794023903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da725f61-dba7-4c8b-b73b-b9d447176964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f0fddecd2b4bc19bba9332ad6df36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:39:47Z,use_quota=True,user_id='f37e9ccd07084ed58fdecd76f5c57dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a67d9c-30b9-4571-95bf-9e10db7bed55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a67d9c-30b9-4571-95bf-9e10db7bed55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8562867a-f175-4671-84a7-c8b4c03d1f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8562867a-f175-4671-84a7-c8b4c03d1f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da725f61-dba7-4c8b-b73b-b9d447176964', 'volume_name': 'volume-da725f61-dba7-4c8b-b73b-b9d447176964', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47dd5391-0f1d-44e8-9754-f06c6eda2974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47dd5391-0f1d-44e8-9754-f06c6eda2974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3348f4-06bf-4bfd-8b1f-f2d5927b88d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:46 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Volume da725f61-dba7-4c8b-b73b-b9d447176964: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da725f61-dba7-4c8b-b73b-b9d447176964', 'volume_size': 1}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1794023903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da725f61-dba7-4c8b-b73b-b9d447176964,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f0fddecd2b4bc19bba9332ad6df36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:39:47Z,use_quota=True,user_id='f37e9ccd07084ed58fdecd76f5c57dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Creating volume da725f61-dba7-4c8b-b73b-b9d447176964 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:46 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:39:47 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:39:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:47 devstack sudo[114916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964 1073741824
Aug 12 16:39:47 devstack sudo[114916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:47 devstack sudo[114916]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964 1073741824" returned: 0 in 0.408s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:47 devstack sudo[114921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964
Aug 12 16:39:47 devstack sudo[114921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:47 devstack sudo[114921]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964" returned: 0 in 0.253s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:47 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:39:47 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f3348f4-06bf-4bfd-8b1f-f2d5927b88d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da725f61-dba7-4c8b-b73b-b9d447176964', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae8da84-f250-44de-b804-52922587f961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:47 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Volume volume-da725f61-dba7-4c8b-b73b-b9d447176964 (da725f61-dba7-4c8b-b73b-b9d447176964): created successfully
Aug 12 16:39:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aae8da84-f250-44de-b804-52922587f961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:47 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Flow 'volume_create_manager' (2e461b2a-5f51-4f63-ba37-2f8f60e10be3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:39:47 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-3a8c0b8d-0824-461f-be29-3df733e97b6b tempest-ProjectMemberTests-1974885304 None] Created volume successfully.
Aug 12 16:39:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f1bf67a7-e41a-476c-b2dc-11e811ce44b7 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f1bf67a7-e41a-476c-b2dc-11e811ce44b7 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:48 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-f1bf67a7-e41a-476c-b2dc-11e811ce44b7 tempest-ProjectMemberTests-1974885304 None] Creating offline snapshot 0be5fa85-5f5d-424d-8b89-8f055b81bd6c of volume da725f61-dba7-4c8b-b73b-b9d447176964 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:39:48 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[265c0493-7bc1-405a-a143-e53f7b3bf892]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1bf67a7-e41a-476c-b2dc-11e811ce44b7 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:48 devstack sudo[114924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964
Aug 12 16:39:48 devstack sudo[114924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:48 devstack sudo[114924]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1bf67a7-e41a-476c-b2dc-11e811ce44b7 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964" returned: 0 in 0.347s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1bf67a7-e41a-476c-b2dc-11e811ce44b7 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:48 devstack sudo[114930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c 1G
Aug 12 16:39:48 devstack sudo[114930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:48 devstack sudo[114930]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1bf67a7-e41a-476c-b2dc-11e811ce44b7 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c 1G" returned: 0 in 0.377s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:48 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1bf67a7-e41a-476c-b2dc-11e811ce44b7 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da725f61-dba7-4c8b-b73b-b9d447176964 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:48 devstack sudo[114935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da725f61-dba7-4c8b-b73b-b9d447176964 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c
Aug 12 16:39:48 devstack sudo[114935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:49 devstack sudo[114935]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1bf67a7-e41a-476c-b2dc-11e811ce44b7 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da725f61-dba7-4c8b-b73b-b9d447176964 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c" returned: 0 in 0.285s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:49 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-f1bf67a7-e41a-476c-b2dc-11e811ce44b7 tempest-ProjectMemberTests-1974885304 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c is being set with open permissions: ugo+rw
Aug 12 16:39:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1bf67a7-e41a-476c-b2dc-11e811ce44b7 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:49 devstack sudo[114941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c
Aug 12 16:39:49 devstack sudo[114941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:49 devstack sudo[114941]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1bf67a7-e41a-476c-b2dc-11e811ce44b7 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c" returned: 0 in 0.239s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1bf67a7-e41a-476c-b2dc-11e811ce44b7 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:49 devstack sudo[114944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.info
Aug 12 16:39:49 devstack sudo[114944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:49 devstack sudo[114944]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1bf67a7-e41a-476c-b2dc-11e811ce44b7 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.info" returned: 0 in 0.243s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:49 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-f1bf67a7-e41a-476c-b2dc-11e811ce44b7 tempest-ProjectMemberTests-1974885304 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.info is being set with open permissions: ugo+rw
Aug 12 16:39:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1bf67a7-e41a-476c-b2dc-11e811ce44b7 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:49 devstack sudo[114947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.info
Aug 12 16:39:49 devstack sudo[114947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:49 devstack sudo[114947]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f1bf67a7-e41a-476c-b2dc-11e811ce44b7 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.info" returned: 0 in 0.233s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:49 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f1bf67a7-e41a-476c-b2dc-11e811ce44b7 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.800s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:49 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-f1bf67a7-e41a-476c-b2dc-11e811ce44b7 tempest-ProjectMemberTests-1974885304 None] Create snapshot completed successfully
Aug 12 16:39:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-0be5fa85-5f5d-424d-8b89-8f055b81bd6c-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-0be5fa85-5f5d-424d-8b89-8f055b81bd6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-da725f61-dba7-4c8b-b73b-b9d447176964" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-da725f61-dba7-4c8b-b73b-b9d447176964" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-0be5fa85-5f5d-424d-8b89-8f055b81bd6c" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:50 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-0be5fa85-5f5d-424d-8b89-8f055b81bd6c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] Deleting offline snapshot 0be5fa85-5f5d-424d-8b89-8f055b81bd6c of volume da725f61-dba7-4c8b-b73b-b9d447176964 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:39:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] snapshot_file for this snap is: volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:39:50 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cf5199-78cf-4e53-9684-05a637f480f4]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:50 devstack sudo[114950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c
Aug 12 16:39:50 devstack sudo[114950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:50 devstack sudo[114950]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c" returned: 0 in 0.343s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:50 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da725f61-dba7-4c8b-b73b-b9d447176964(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:39:50 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d3db8b-e4aa-4c24-bc48-f2afd66046a1]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:50 devstack sudo[114956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964
Aug 12 16:39:50 devstack sudo[114956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:50 devstack sudo[114956]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964" returned: 0 in 0.343s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:50 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:51 devstack sudo[114961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c
Aug 12 16:39:51 devstack sudo[114961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:51 devstack sudo[114961]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c" returned: 0 in 0.338s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:51 devstack sudo[114966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c
Aug 12 16:39:51 devstack sudo[114966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:51 devstack sudo[114966]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:51 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964.0be5fa85-5f5d-424d-8b89-8f055b81bd6c" returned: 0 in 0.242s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-0be5fa85-5f5d-424d-8b89-8f055b81bd6c" released by "_delete_snapshot" :: held 1.358s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-da725f61-dba7-4c8b-b73b-b9d447176964" released by "delete_snapshot" :: held 1.378s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:51 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] Created reservations ['97be6200-6c07-463c-83ab-b456bd9fbcbd', '5a49df83-b2f1-4380-bff9-54b273ed4e0c', '75f060c6-8b07-46bb-8afa-f73d91af7d04', 'e67b6a49-a5cf-4cca-83dc-711ff1f522f9'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:51 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] Delete snapshot completed successfully.
Aug 12 16:39:51 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-04600722-5f36-4f75-97b0-7e1d1ed2bbd7 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-0be5fa85-5f5d-424d-8b89-8f055b81bd6c-delete_snapshot" released by "delete_snapshot" :: held 1.500s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:52 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-da725f61-dba7-4c8b-b73b-b9d447176964-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:52 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-da725f61-dba7-4c8b-b73b-b9d447176964-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:52 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-da725f61-dba7-4c8b-b73b-b9d447176964" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:52 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-da725f61-dba7-4c8b-b73b-b9d447176964" acquired by "delete_volume" :: waited 0.019s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:52 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84bcfdc-bec6-4ff0-a46f-82bd318717da]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:52 devstack sudo[114969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964
Aug 12 16:39:52 devstack sudo[114969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:52 devstack sudo[114969]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964" returned: 0 in 0.359s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:52 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:52 devstack sudo[114974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964
Aug 12 16:39:52 devstack sudo[114974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:53 devstack sudo[114974]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-da725f61-dba7-4c8b-b73b-b9d447176964" returned: 0 in 0.238s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-da725f61-dba7-4c8b-b73b-b9d447176964" released by "delete_volume" :: held 0.652s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] Created reservations ['37a6378d-b31d-430f-90d3-aa4e10eb7f41', '2a33d5be-2be4-4328-af1f-36814b8c02d1', '4a7e523d-40df-4751-84d1-60451a6859af', '89620145-45d5-4a86-8102-c8a163a2d32c'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:53 devstack sudo[114977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:39:53 devstack sudo[114977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:53 devstack sudo[114977]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.238s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:39:53 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] Deleted volume successfully.
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-170ce5c2-81b7-4be3-9d32-d52f545f87e9 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-da725f61-dba7-4c8b-b73b-b9d447176964-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Flow 'volume_create_manager' (00195a1e-76ef-4b65-ab21-dbca603a2ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b828ad7-e5d9-4c61-b337-adda8715001a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b828ad7-e5d9-4c61-b337-adda8715001a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1028678575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83ce1bb-47e2-4fd8-bbb6-3c116326eb26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f0fddecd2b4bc19bba9332ad6df36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:39:54Z,use_quota=True,user_id='f37e9ccd07084ed58fdecd76f5c57dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84ebd4a-ce09-41f9-b317-38b01cb205f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a84ebd4a-ce09-41f9-b317-38b01cb205f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb85e24-5e9a-45c1-b16e-e01e25c6a8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb85e24-5e9a-45c1-b16e-e01e25c6a8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c83ce1bb-47e2-4fd8-bbb6-3c116326eb26', 'volume_name': 'volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ce7be2-ade3-4106-8b7f-66adae221676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6ce7be2-ade3-4106-8b7f-66adae221676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956f0c27-0477-4227-8e95-4035b139fe19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:53 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Volume c83ce1bb-47e2-4fd8-bbb6-3c116326eb26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26', 'volume_size': 1}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1028678575',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83ce1bb-47e2-4fd8-bbb6-3c116326eb26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f0fddecd2b4bc19bba9332ad6df36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:39:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:39:54Z,use_quota=True,user_id='f37e9ccd07084ed58fdecd76f5c57dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Creating volume c83ce1bb-47e2-4fd8-bbb6-3c116326eb26 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:39:53 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:39:53 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:54 devstack sudo[114980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26 1073741824
Aug 12 16:39:54 devstack sudo[114980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:54 devstack sudo[114980]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26 1073741824" returned: 0 in 0.401s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:54 devstack sudo[114986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26
Aug 12 16:39:54 devstack sudo[114986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:54 devstack sudo[114986]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26" returned: 0 in 0.239s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:54 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:39:54 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (956f0c27-0477-4227-8e95-4035b139fe19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f02dbbc6-f613-4ba0-b017-58f718c4e439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:39:54 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Volume volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26 (c83ce1bb-47e2-4fd8-bbb6-3c116326eb26): created successfully
Aug 12 16:39:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f02dbbc6-f613-4ba0-b017-58f718c4e439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:39:54 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Flow 'volume_create_manager' (00195a1e-76ef-4b65-ab21-dbca603a2ae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:39:54 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-53774467-f39c-4dc3-9285-1aa1c411f4a2 tempest-ProjectMemberTests-1974885304 None] Created volume successfully.
Aug 12 16:39:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-456ac449-fdc9-413e-9bed-9e104af332ca tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:39:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-456ac449-fdc9-413e-9bed-9e104af332ca tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:39:55 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-456ac449-fdc9-413e-9bed-9e104af332ca tempest-ProjectMemberTests-1974885304 None] Creating offline snapshot 10b2bfca-def4-4c89-8c14-cdfba3b13298 of volume c83ce1bb-47e2-4fd8-bbb6-3c116326eb26 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:39:55 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aa451c-502d-4c59-9d2a-c8015dc58398]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-456ac449-fdc9-413e-9bed-9e104af332ca tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:55 devstack sudo[114989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26
Aug 12 16:39:55 devstack sudo[114989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:55 devstack sudo[114989]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-456ac449-fdc9-413e-9bed-9e104af332ca tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26" returned: 0 in 0.356s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-456ac449-fdc9-413e-9bed-9e104af332ca tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:55 devstack sudo[114994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298 1G
Aug 12 16:39:55 devstack sudo[114994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:55 devstack sudo[114994]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-456ac449-fdc9-413e-9bed-9e104af332ca tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298 1G" returned: 0 in 0.380s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:55 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-456ac449-fdc9-413e-9bed-9e104af332ca tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:55 devstack sudo[115000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298
Aug 12 16:39:55 devstack sudo[115000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:56 devstack sudo[115000]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-456ac449-fdc9-413e-9bed-9e104af332ca tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298" returned: 0 in 0.285s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:56 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-456ac449-fdc9-413e-9bed-9e104af332ca tempest-ProjectMemberTests-1974885304 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298 is being set with open permissions: ugo+rw
Aug 12 16:39:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-456ac449-fdc9-413e-9bed-9e104af332ca tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:56 devstack sudo[115006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298
Aug 12 16:39:56 devstack sudo[115006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:56 devstack sudo[115006]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-456ac449-fdc9-413e-9bed-9e104af332ca tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298" returned: 0 in 0.238s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-456ac449-fdc9-413e-9bed-9e104af332ca tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:56 devstack sudo[115009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.info
Aug 12 16:39:56 devstack sudo[115009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:56 devstack sudo[115009]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-456ac449-fdc9-413e-9bed-9e104af332ca tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.info" returned: 0 in 0.248s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:56 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-456ac449-fdc9-413e-9bed-9e104af332ca tempest-ProjectMemberTests-1974885304 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.info is being set with open permissions: ugo+rw
Aug 12 16:39:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-456ac449-fdc9-413e-9bed-9e104af332ca tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:56 devstack sudo[115012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.info
Aug 12 16:39:56 devstack sudo[115012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:56 devstack sudo[115012]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-456ac449-fdc9-413e-9bed-9e104af332ca tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.info" returned: 0 in 0.235s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:56 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-456ac449-fdc9-413e-9bed-9e104af332ca tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.813s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:39:56 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-456ac449-fdc9-413e-9bed-9e104af332ca tempest-ProjectMemberTests-1974885304 None] Create snapshot completed successfully
Aug 12 16:39:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-10b2bfca-def4-4c89-8c14-cdfba3b13298-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-10b2bfca-def4-4c89-8c14-cdfba3b13298-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-10b2bfca-def4-4c89-8c14-cdfba3b13298" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:57 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-10b2bfca-def4-4c89-8c14-cdfba3b13298" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] Deleting offline snapshot 10b2bfca-def4-4c89-8c14-cdfba3b13298 of volume c83ce1bb-47e2-4fd8-bbb6-3c116326eb26 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:39:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] snapshot_file for this snap is: volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:39:57 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68e1b62-02b2-4b7b-8f27-4187689e060f]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:57 devstack sudo[115015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298
Aug 12 16:39:57 devstack sudo[115015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:57 devstack sudo[115015]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298" returned: 0 in 0.342s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:57 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:39:57 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[16236f5c-125e-4f28-a135-08d6180abb58]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:57 devstack sudo[115020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26
Aug 12 16:39:57 devstack sudo[115020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:57 devstack sudo[115020]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26" returned: 0 in 0.348s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:57 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:57 devstack sudo[115025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298
Aug 12 16:39:58 devstack sudo[115025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:58 devstack sudo[115025]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298" returned: 0 in 0.326s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:58 devstack sudo[115030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298
Aug 12 16:39:58 devstack sudo[115030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:58 devstack sudo[115030]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:58 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26.10b2bfca-def4-4c89-8c14-cdfba3b13298" returned: 0 in 0.240s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:58 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-10b2bfca-def4-4c89-8c14-cdfba3b13298" released by "_delete_snapshot" :: held 1.345s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:58 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26" released by "delete_snapshot" :: held 1.366s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:58 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] Created reservations ['d2969f75-e2fc-47ac-bedb-193740568e0a', 'f1277fc1-55df-4c78-9203-5aa3fb1aee51', '385c1acb-6dd8-410a-a78d-79e28f34ffbf', 'cd80def5-81f1-4bcd-9568-91c386e9d0d9'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:39:58 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] Delete snapshot completed successfully.
Aug 12 16:39:58 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-0f549999-cdef-49d5-8719-36cbda70e864 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-10b2bfca-def4-4c89-8c14-cdfba3b13298-delete_snapshot" released by "delete_snapshot" :: held 1.488s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:39:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] Lock "cinder-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:39:59 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26" acquired by "delete_volume" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:39:59 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a27fea-d607-4985-8ab5-639478071ddf]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:39:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:59 devstack sudo[115033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26
Aug 12 16:39:59 devstack sudo[115033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:39:59 devstack sudo[115033]: pam_unix(sudo:session): session closed for user root
Aug 12 16:39:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26" returned: 0 in 0.347s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:39:59 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:39:59 devstack sudo[115038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26
Aug 12 16:39:59 devstack sudo[115038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:00 devstack sudo[115038]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26" returned: 0 in 0.246s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26" released by "delete_volume" :: held 0.646s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] Created reservations ['fd53c3c3-7011-48bb-8dfe-f25831848d06', 'e64b0129-e31c-4728-8618-962972d61c64', '82422249-2e6e-4619-a97d-d2d7ecfdedc2', 'f1f786a5-0659-4316-afa9-dddabac0af5e'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:00 devstack sudo[115041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:40:00 devstack sudo[115041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:00 devstack sudo[115041]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.240s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:40:00 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] Deleted volume successfully.
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-9fd8e506-5a71-4ebc-b5c7-e51c0bc8aade tempest-ProjectMemberTests-1974885304 None] Lock "cinder-c83ce1bb-47e2-4fd8-bbb6-3c116326eb26-delete_volume" released by "delete_volume" :: held 1.131s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Flow 'volume_create_manager' (bc130f32-9a11-4827-a451-080906266272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338acc73-f9c4-42cc-a518-4d743af3e21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (338acc73-f9c4-42cc-a518-4d743af3e21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141317541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b3767f-7b68-44df-a872-d419f40c9d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f0fddecd2b4bc19bba9332ad6df36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:40:01Z,use_quota=True,user_id='f37e9ccd07084ed58fdecd76f5c57dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (777236fb-5890-416f-a973-52421328c1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (777236fb-5890-416f-a973-52421328c1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b365a7f5-eb6f-49ad-80e3-062995300706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b365a7f5-eb6f-49ad-80e3-062995300706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33b3767f-7b68-44df-a872-d419f40c9d9d', 'volume_name': 'volume-33b3767f-7b68-44df-a872-d419f40c9d9d', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167829b5-c819-48ad-9519-2f25c36fd12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (167829b5-c819-48ad-9519-2f25c36fd12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bae9b03-277b-4171-82af-c608ef02fab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:00 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Volume 33b3767f-7b68-44df-a872-d419f40c9d9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33b3767f-7b68-44df-a872-d419f40c9d9d', 'volume_size': 1}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:40:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141317541',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b3767f-7b68-44df-a872-d419f40c9d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0f0fddecd2b4bc19bba9332ad6df36d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:40:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:40:01Z,use_quota=True,user_id='f37e9ccd07084ed58fdecd76f5c57dff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Creating volume 33b3767f-7b68-44df-a872-d419f40c9d9d {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:40:00 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:40:00 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:01 devstack sudo[115045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d 1073741824
Aug 12 16:40:01 devstack sudo[115045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:01 devstack sudo[115045]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d 1073741824" returned: 0 in 0.407s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:01 devstack sudo[115051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d
Aug 12 16:40:01 devstack sudo[115051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:01 devstack sudo[115051]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d" returned: 0 in 0.252s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:01 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:40:01 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:01 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:UPDATE=208,cinder:SELECT=170,cinder:INSERT=58,cinder:DELETE=15 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:40:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bae9b03-277b-4171-82af-c608ef02fab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b3767f-7b68-44df-a872-d419f40c9d9d', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87fe61c5-bbca-48cf-aa8b-c4a02ebaa0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:01 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=144,cinder:INSERT=56,cinder:UPDATE=218,cinder:DELETE=18 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:40:01 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Volume volume-33b3767f-7b68-44df-a872-d419f40c9d9d (33b3767f-7b68-44df-a872-d419f40c9d9d): created successfully
Aug 12 16:40:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87fe61c5-bbca-48cf-aa8b-c4a02ebaa0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:01 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Flow 'volume_create_manager' (bc130f32-9a11-4827-a451-080906266272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:40:01 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-0608f27a-da27-4f43-89df-2799c7858f68 tempest-ProjectMemberTests-1974885304 None] Created volume successfully.
Aug 12 16:40:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d20b41ae-acdc-4e73-ace4-b001b228b2b5 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d20b41ae-acdc-4e73-ace4-b001b228b2b5 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:02 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-d20b41ae-acdc-4e73-ace4-b001b228b2b5 tempest-ProjectMemberTests-1974885304 None] Creating offline snapshot e2c2538f-fc6c-467d-9c89-54fa65ee7528 of volume 33b3767f-7b68-44df-a872-d419f40c9d9d {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:40:02 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa175fd-8f94-40ba-8287-82ff7c56623a]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d20b41ae-acdc-4e73-ace4-b001b228b2b5 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:02 devstack sudo[115054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d
Aug 12 16:40:02 devstack sudo[115054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:02 devstack sudo[115054]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d20b41ae-acdc-4e73-ace4-b001b228b2b5 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d" returned: 0 in 0.351s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d20b41ae-acdc-4e73-ace4-b001b228b2b5 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:02 devstack sudo[115059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528 1G
Aug 12 16:40:02 devstack sudo[115059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:02 devstack sudo[115059]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d20b41ae-acdc-4e73-ace4-b001b228b2b5 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528 1G" returned: 0 in 0.389s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:02 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d20b41ae-acdc-4e73-ace4-b001b228b2b5 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b3767f-7b68-44df-a872-d419f40c9d9d -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:02 devstack sudo[115067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b3767f-7b68-44df-a872-d419f40c9d9d -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528
Aug 12 16:40:02 devstack sudo[115067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:03 devstack sudo[115067]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d20b41ae-acdc-4e73-ace4-b001b228b2b5 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33b3767f-7b68-44df-a872-d419f40c9d9d -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528" returned: 0 in 0.280s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:03 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-d20b41ae-acdc-4e73-ace4-b001b228b2b5 tempest-ProjectMemberTests-1974885304 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528 is being set with open permissions: ugo+rw
Aug 12 16:40:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d20b41ae-acdc-4e73-ace4-b001b228b2b5 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:03 devstack sudo[115072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528
Aug 12 16:40:03 devstack sudo[115072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:03 devstack sudo[115072]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d20b41ae-acdc-4e73-ace4-b001b228b2b5 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528" returned: 0 in 0.241s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d20b41ae-acdc-4e73-ace4-b001b228b2b5 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:03 devstack sudo[115075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.info
Aug 12 16:40:03 devstack sudo[115075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:03 devstack sudo[115075]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d20b41ae-acdc-4e73-ace4-b001b228b2b5 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.info" returned: 0 in 0.247s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:03 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-d20b41ae-acdc-4e73-ace4-b001b228b2b5 tempest-ProjectMemberTests-1974885304 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.info is being set with open permissions: ugo+rw
Aug 12 16:40:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d20b41ae-acdc-4e73-ace4-b001b228b2b5 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:03 devstack sudo[115078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.info
Aug 12 16:40:03 devstack sudo[115078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:03 devstack sudo[115078]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d20b41ae-acdc-4e73-ace4-b001b228b2b5 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.info" returned: 0 in 0.235s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:03 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d20b41ae-acdc-4e73-ace4-b001b228b2b5 tempest-ProjectMemberTests-1974885304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.815s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:03 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-d20b41ae-acdc-4e73-ace4-b001b228b2b5 tempest-ProjectMemberTests-1974885304 None] Create snapshot completed successfully
Aug 12 16:40:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-e2c2538f-fc6c-467d-9c89-54fa65ee7528-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-e2c2538f-fc6c-467d-9c89-54fa65ee7528-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-33b3767f-7b68-44df-a872-d419f40c9d9d" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-33b3767f-7b68-44df-a872-d419f40c9d9d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-e2c2538f-fc6c-467d-9c89-54fa65ee7528" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:04 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-e2c2538f-fc6c-467d-9c89-54fa65ee7528" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:04 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] Deleting offline snapshot e2c2538f-fc6c-467d-9c89-54fa65ee7528 of volume 33b3767f-7b68-44df-a872-d419f40c9d9d {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:40:04 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] snapshot_file for this snap is: volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:40:04 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2e243b-0639-4336-8c07-27b44b49fe05]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:04 devstack sudo[115081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528
Aug 12 16:40:04 devstack sudo[115081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:04 devstack sudo[115081]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528" returned: 0 in 0.385s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:04 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33b3767f-7b68-44df-a872-d419f40c9d9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:40:04 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17a0463-c951-4858-95ff-d5014bd70d84]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:04 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:04 devstack sudo[115087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d
Aug 12 16:40:04 devstack sudo[115087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:05 devstack sudo[115087]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d" returned: 0 in 0.364s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:05 devstack sudo[115092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528
Aug 12 16:40:05 devstack sudo[115092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:05 devstack sudo[115092]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528" returned: 0 in 0.325s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:05 devstack sudo[115097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528
Aug 12 16:40:05 devstack sudo[115097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:05 devstack sudo[115097]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d.e2c2538f-fc6c-467d-9c89-54fa65ee7528" returned: 0 in 0.238s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-e2c2538f-fc6c-467d-9c89-54fa65ee7528" released by "_delete_snapshot" :: held 1.402s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-33b3767f-7b68-44df-a872-d419f40c9d9d" released by "delete_snapshot" :: held 1.423s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:05 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] Created reservations ['1d45f694-5871-482c-8594-93ef18bb5592', '5f6d9760-bc8e-48ad-9316-0aeaf6e56aa7', '45a99e93-20d0-473a-a76c-37280b24bbcf', 'f467f6dc-9850-49ee-8f82-371de42f95f1'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:40:05 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] Delete snapshot completed successfully.
Aug 12 16:40:05 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-a579860d-8942-4416-a44d-72f52da70910 tempest-ProjectMemberTests-1974885304 None] Lock "cinder-e2c2538f-fc6c-467d-9c89-54fa65ee7528-delete_snapshot" released by "delete_snapshot" :: held 1.550s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-33b3767f-7b68-44df-a872-d419f40c9d9d-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] Lock "cinder-33b3767f-7b68-44df-a872-d419f40c9d9d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] Acquiring lock "cinder-quobyte-33b3767f-7b68-44df-a872-d419f40c9d9d" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:06 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-33b3767f-7b68-44df-a872-d419f40c9d9d" acquired by "delete_volume" :: waited 0.013s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:06 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8378b3-81fe-4f50-9f23-8408a819b656]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:06 devstack sudo[115100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d
Aug 12 16:40:06 devstack sudo[115100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:06 devstack sudo[115100]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d" returned: 0 in 0.348s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:06 devstack sudo[115106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d
Aug 12 16:40:06 devstack sudo[115106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:07 devstack sudo[115106]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33b3767f-7b68-44df-a872-d419f40c9d9d" returned: 0 in 0.249s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:07 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] Lock "cinder-quobyte-33b3767f-7b68-44df-a872-d419f40c9d9d" released by "delete_volume" :: held 0.651s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:07 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] Created reservations ['b4fbe4d3-7345-4e24-a86b-df306630c408', '53340912-aa1e-4296-94d5-b696a72ea010', '2ad0ccec-ef9f-44d1-a9e4-fa0bf1df7ecd', 'fe3ce91c-c9a5-4771-bfc8-a1c7a5f041f8'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:40:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:40:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:40:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:07 devstack sudo[115109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:40:07 devstack sudo[115109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:07 devstack sudo[115109]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.244s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:07 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:40:07 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] Deleted volume successfully.
Aug 12 16:40:07 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-5c156078-cfdd-4fb4-8484-66ecd007d8ab tempest-ProjectMemberTests-1974885304 None] Lock "cinder-33b3767f-7b68-44df-a872-d419f40c9d9d-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Flow 'volume_create_manager' (66ef96af-95ba-4e54-9f54-c66551cfbe01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2d7def-b256-46d3-9ea5-d98cdd8792f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2d7def-b256-46d3-9ea5-d98cdd8792f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-222700477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb5b64b-6120-4977-a517-7272fa57dbbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78cf0a4e76014a28a6606eccf1c95224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:40:11Z,use_quota=True,user_id='9eb54cbbd2224b3098aa1d37281b2965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a13018db-d3d4-47bb-8334-215ac52dfaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a13018db-d3d4-47bb-8334-215ac52dfaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98cbc0b-0ca0-4306-8601-891b5fb63f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e98cbc0b-0ca0-4306-8601-891b5fb63f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcb5b64b-6120-4977-a517-7272fa57dbbb', 'volume_name': 'volume-fcb5b64b-6120-4977-a517-7272fa57dbbb', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6e022f-bf2c-4035-8d65-88f6c9084bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d6e022f-bf2c-4035-8d65-88f6c9084bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1319b058-08b4-4538-969a-e8b71f89719c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:11 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Volume fcb5b64b-6120-4977-a517-7272fa57dbbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcb5b64b-6120-4977-a517-7272fa57dbbb', 'volume_size': 1}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-222700477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcb5b64b-6120-4977-a517-7272fa57dbbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78cf0a4e76014a28a6606eccf1c95224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:40:11Z,use_quota=True,user_id='9eb54cbbd2224b3098aa1d37281b2965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Creating volume fcb5b64b-6120-4977-a517-7272fa57dbbb {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:40:11 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:11 devstack sudo[115114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb 1073741824
Aug 12 16:40:11 devstack sudo[115114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:11 devstack sudo[115114]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb 1073741824" returned: 0 in 0.424s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:11 devstack sudo[115119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb
Aug 12 16:40:11 devstack sudo[115119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:11 devstack sudo[115119]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb" returned: 0 in 0.246s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:40:11 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1319b058-08b4-4538-969a-e8b71f89719c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcb5b64b-6120-4977-a517-7272fa57dbbb', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fa0fe5-8b19-48f7-86f6-5b7e708e6504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:12 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Volume volume-fcb5b64b-6120-4977-a517-7272fa57dbbb (fcb5b64b-6120-4977-a517-7272fa57dbbb): created successfully
Aug 12 16:40:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6fa0fe5-8b19-48f7-86f6-5b7e708e6504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:12 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Flow 'volume_create_manager' (66ef96af-95ba-4e54-9f54-c66551cfbe01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:40:12 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-cdf774f7-8a27-41a1-a6f1-dd8da5b6893a tempest-ProjectReaderTests-659018349 None] Created volume successfully.
Aug 12 16:40:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ba7346cc-8c02-4d43-803b-28f7096703a3 tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ba7346cc-8c02-4d43-803b-28f7096703a3 tempest-ProjectReaderTests-659018349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:12 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-ba7346cc-8c02-4d43-803b-28f7096703a3 tempest-ProjectReaderTests-659018349 None] Creating offline snapshot e26ee3e8-7a41-473b-8fce-10ec3bfc9715 of volume fcb5b64b-6120-4977-a517-7272fa57dbbb {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:40:12 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44fb21f-87a7-4cba-ace0-a4e8ce022416]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba7346cc-8c02-4d43-803b-28f7096703a3 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:12 devstack sudo[115122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb
Aug 12 16:40:12 devstack sudo[115122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:12 devstack sudo[115122]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba7346cc-8c02-4d43-803b-28f7096703a3 tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb" returned: 0 in 0.359s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:12 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba7346cc-8c02-4d43-803b-28f7096703a3 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:12 devstack sudo[115127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715 1G
Aug 12 16:40:12 devstack sudo[115127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:13 devstack sudo[115127]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba7346cc-8c02-4d43-803b-28f7096703a3 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715 1G" returned: 0 in 0.390s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba7346cc-8c02-4d43-803b-28f7096703a3 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb5b64b-6120-4977-a517-7272fa57dbbb -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:13 devstack sudo[115133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb5b64b-6120-4977-a517-7272fa57dbbb -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715
Aug 12 16:40:13 devstack sudo[115133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:13 devstack sudo[115133]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba7346cc-8c02-4d43-803b-28f7096703a3 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcb5b64b-6120-4977-a517-7272fa57dbbb -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715" returned: 0 in 0.292s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:13 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-ba7346cc-8c02-4d43-803b-28f7096703a3 tempest-ProjectReaderTests-659018349 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715 is being set with open permissions: ugo+rw
Aug 12 16:40:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba7346cc-8c02-4d43-803b-28f7096703a3 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:13 devstack sudo[115138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715
Aug 12 16:40:13 devstack sudo[115138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:13 devstack sudo[115138]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba7346cc-8c02-4d43-803b-28f7096703a3 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715" returned: 0 in 0.250s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba7346cc-8c02-4d43-803b-28f7096703a3 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:13 devstack sudo[115141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.info
Aug 12 16:40:13 devstack sudo[115141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:13 devstack sudo[115141]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba7346cc-8c02-4d43-803b-28f7096703a3 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.info" returned: 0 in 0.241s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:13 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-ba7346cc-8c02-4d43-803b-28f7096703a3 tempest-ProjectReaderTests-659018349 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.info is being set with open permissions: ugo+rw
Aug 12 16:40:13 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba7346cc-8c02-4d43-803b-28f7096703a3 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:14 devstack sudo[115144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.info
Aug 12 16:40:14 devstack sudo[115144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:14 devstack sudo[115144]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-ba7346cc-8c02-4d43-803b-28f7096703a3 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.info" returned: 0 in 0.240s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-ba7346cc-8c02-4d43-803b-28f7096703a3 tempest-ProjectReaderTests-659018349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:14 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-ba7346cc-8c02-4d43-803b-28f7096703a3 tempest-ProjectReaderTests-659018349 None] Create snapshot completed successfully
Aug 12 16:40:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-e26ee3e8-7a41-473b-8fce-10ec3bfc9715-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] Lock "cinder-e26ee3e8-7a41-473b-8fce-10ec3bfc9715-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-quobyte-fcb5b64b-6120-4977-a517-7272fa57dbbb" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-fcb5b64b-6120-4977-a517-7272fa57dbbb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-quobyte-e26ee3e8-7a41-473b-8fce-10ec3bfc9715" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-e26ee3e8-7a41-473b-8fce-10ec3bfc9715" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] Deleting offline snapshot e26ee3e8-7a41-473b-8fce-10ec3bfc9715 of volume fcb5b64b-6120-4977-a517-7272fa57dbbb {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:40:14 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] snapshot_file for this snap is: volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:40:14 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[80cbfddb-4f6b-4722-9e43-474bbd12a6ed]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:14 devstack sudo[115147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715
Aug 12 16:40:14 devstack sudo[115147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:15 devstack sudo[115147]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715" returned: 0 in 0.343s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcb5b64b-6120-4977-a517-7272fa57dbbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:40:15 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55015be-896a-474a-a360-f6178f5f8b60]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:15 devstack sudo[115152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb
Aug 12 16:40:15 devstack sudo[115152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:15 devstack sudo[115152]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb" returned: 0 in 0.344s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:15 devstack sudo[115157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715
Aug 12 16:40:15 devstack sudo[115157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:15 devstack sudo[115157]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715" returned: 0 in 0.334s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:15 devstack sudo[115162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715
Aug 12 16:40:15 devstack sudo[115162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:16 devstack sudo[115162]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb.e26ee3e8-7a41-473b-8fce-10ec3bfc9715" returned: 0 in 0.246s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-e26ee3e8-7a41-473b-8fce-10ec3bfc9715" released by "_delete_snapshot" :: held 1.351s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-fcb5b64b-6120-4977-a517-7272fa57dbbb" released by "delete_snapshot" :: held 1.372s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:16 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] Created reservations ['b4a91dd5-5092-4b46-8ccf-53c9bc2014b1', 'fd18ac0d-0a24-4482-8e0e-ec6dd4de962d', '11d9d555-e830-472b-bb0a-cbe92c10fe99', '5e10c53e-2913-49b9-9d39-0a18219234c5'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:40:16 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] Delete snapshot completed successfully.
Aug 12 16:40:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-dc5c8157-6811-46ae-b090-a58beb0d2e9e tempest-ProjectReaderTests-659018349 None] Lock "cinder-e26ee3e8-7a41-473b-8fce-10ec3bfc9715-delete_snapshot" released by "delete_snapshot" :: held 1.495s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-fcb5b64b-6120-4977-a517-7272fa57dbbb-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] Lock "cinder-fcb5b64b-6120-4977-a517-7272fa57dbbb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-quobyte-fcb5b64b-6120-4977-a517-7272fa57dbbb" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-fcb5b64b-6120-4977-a517-7272fa57dbbb" acquired by "delete_volume" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:16 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2ab18a-321a-4ea1-8388-13c06b123568]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:17 devstack sudo[115165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb
Aug 12 16:40:17 devstack sudo[115165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:17 devstack sudo[115165]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb" returned: 0 in 0.346s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:17 devstack sudo[115170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb
Aug 12 16:40:17 devstack sudo[115170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:17 devstack sudo[115170]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-fcb5b64b-6120-4977-a517-7272fa57dbbb" returned: 0 in 0.236s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-fcb5b64b-6120-4977-a517-7272fa57dbbb" released by "delete_volume" :: held 0.638s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:17 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] Created reservations ['f40de571-c4d2-4a16-8e50-7a29b12b14ac', '3b8e4734-61d1-4cc3-8f65-5927d6e7b1f7', '84f93054-2367-4c1e-8d2b-0c94807f0c12', '991b4b55-e667-47ad-8b74-f296b8630114'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:40:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:40:17 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:40:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:17 devstack sudo[115173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:40:17 devstack sudo[115173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:17 devstack sudo[115173]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.242s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:17 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:40:17 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] Deleted volume successfully.
Aug 12 16:40:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2ab87e8c-b686-4a88-b1fe-d0a882741e97 tempest-ProjectReaderTests-659018349 None] Lock "cinder-fcb5b64b-6120-4977-a517-7272fa57dbbb-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Flow 'volume_create_manager' (a4a1bdcb-cfba-4002-a52f-8cde0a876e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e75c24f-fb36-49a0-ad98-1a8f8b81168f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e75c24f-fb36-49a0-ad98-1a8f8b81168f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1579833045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdadd83-cac6-48eb-ad10-001567320330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78cf0a4e76014a28a6606eccf1c95224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:40:18Z,use_quota=True,user_id='9eb54cbbd2224b3098aa1d37281b2965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e1aed4a-96b2-4cee-9253-a584d6438a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e1aed4a-96b2-4cee-9253-a584d6438a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4d52e1-f0ee-459b-a0c6-04637bd5cc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b4d52e1-f0ee-459b-a0c6-04637bd5cc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcdadd83-cac6-48eb-ad10-001567320330', 'volume_name': 'volume-bcdadd83-cac6-48eb-ad10-001567320330', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c23c99-5c5d-4a30-a843-a44d60858e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c23c99-5c5d-4a30-a843-a44d60858e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add6ea89-1780-40d4-afd7-be3d7cd11954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:18 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Volume bcdadd83-cac6-48eb-ad10-001567320330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcdadd83-cac6-48eb-ad10-001567320330', 'volume_size': 1}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1579833045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdadd83-cac6-48eb-ad10-001567320330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78cf0a4e76014a28a6606eccf1c95224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:40:18Z,use_quota=True,user_id='9eb54cbbd2224b3098aa1d37281b2965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Creating volume bcdadd83-cac6-48eb-ad10-001567320330 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:40:18 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:18 devstack sudo[115176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330 1073741824
Aug 12 16:40:18 devstack sudo[115176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:18 devstack sudo[115176]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330 1073741824" returned: 0 in 0.398s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:18 devstack sudo[115182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330
Aug 12 16:40:18 devstack sudo[115182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:19 devstack sudo[115182]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330" returned: 0 in 0.243s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add6ea89-1780-40d4-afd7-be3d7cd11954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcdadd83-cac6-48eb-ad10-001567320330', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc5c330e-5fd4-4d31-ab25-e1cec278832f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:19 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Volume volume-bcdadd83-cac6-48eb-ad10-001567320330 (bcdadd83-cac6-48eb-ad10-001567320330): created successfully
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc5c330e-5fd4-4d31-ab25-e1cec278832f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Flow 'volume_create_manager' (a4a1bdcb-cfba-4002-a52f-8cde0a876e55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:40:19 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-9a481738-0e29-4810-9260-e731e28bb1b0 tempest-ProjectReaderTests-659018349 None] Created volume successfully.
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:19 devstack sudo[115185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:40:19 devstack sudo[115185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-912dfa2b-2635-46b6-8cad-53faaeb6c5b2 tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-912dfa2b-2635-46b6-8cad-53faaeb6c5b2 tempest-ProjectReaderTests-659018349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-912dfa2b-2635-46b6-8cad-53faaeb6c5b2 tempest-ProjectReaderTests-659018349 None] Creating offline snapshot 915a9185-cca6-4c01-992c-fd98bd57caf0 of volume bcdadd83-cac6-48eb-ad10-001567320330 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2189e5-ca3a-487c-8763-679cc1dee74e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-912dfa2b-2635-46b6-8cad-53faaeb6c5b2 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:19 devstack sudo[115187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330
Aug 12 16:40:19 devstack sudo[115187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:19 devstack sudo[115185]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.262s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 29 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>, <Thread(Rabbit-heartbeat, started daemon 134532925736384)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:40:19 devstack sudo[115187]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-912dfa2b-2635-46b6-8cad-53faaeb6c5b2 tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330" returned: 0 in 0.351s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-912dfa2b-2635-46b6-8cad-53faaeb6c5b2 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:19 devstack sudo[115193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0 1G
Aug 12 16:40:19 devstack sudo[115193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:20 devstack sudo[115193]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-912dfa2b-2635-46b6-8cad-53faaeb6c5b2 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0 1G" returned: 0 in 0.382s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-912dfa2b-2635-46b6-8cad-53faaeb6c5b2 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcdadd83-cac6-48eb-ad10-001567320330 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:20 devstack sudo[115198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcdadd83-cac6-48eb-ad10-001567320330 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0
Aug 12 16:40:20 devstack sudo[115198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:20 devstack sudo[115198]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-912dfa2b-2635-46b6-8cad-53faaeb6c5b2 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcdadd83-cac6-48eb-ad10-001567320330 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0" returned: 0 in 0.285s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:20 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-912dfa2b-2635-46b6-8cad-53faaeb6c5b2 tempest-ProjectReaderTests-659018349 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0 is being set with open permissions: ugo+rw
Aug 12 16:40:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-912dfa2b-2635-46b6-8cad-53faaeb6c5b2 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:20 devstack sudo[115204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0
Aug 12 16:40:20 devstack sudo[115204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:20 devstack sudo[115204]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-912dfa2b-2635-46b6-8cad-53faaeb6c5b2 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0" returned: 0 in 0.236s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:20 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-912dfa2b-2635-46b6-8cad-53faaeb6c5b2 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:20 devstack sudo[115207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.info
Aug 12 16:40:20 devstack sudo[115207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:21 devstack sudo[115207]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-912dfa2b-2635-46b6-8cad-53faaeb6c5b2 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.info" returned: 0 in 0.243s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:21 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-912dfa2b-2635-46b6-8cad-53faaeb6c5b2 tempest-ProjectReaderTests-659018349 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.info is being set with open permissions: ugo+rw
Aug 12 16:40:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-912dfa2b-2635-46b6-8cad-53faaeb6c5b2 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:21 devstack sudo[115210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.info
Aug 12 16:40:21 devstack sudo[115210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:21 devstack sudo[115210]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-912dfa2b-2635-46b6-8cad-53faaeb6c5b2 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.info" returned: 0 in 0.233s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-912dfa2b-2635-46b6-8cad-53faaeb6c5b2 tempest-ProjectReaderTests-659018349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.809s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:21 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-912dfa2b-2635-46b6-8cad-53faaeb6c5b2 tempest-ProjectReaderTests-659018349 None] Create snapshot completed successfully
Aug 12 16:40:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-915a9185-cca6-4c01-992c-fd98bd57caf0-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] Lock "cinder-915a9185-cca6-4c01-992c-fd98bd57caf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-quobyte-bcdadd83-cac6-48eb-ad10-001567320330" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-bcdadd83-cac6-48eb-ad10-001567320330" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-quobyte-915a9185-cca6-4c01-992c-fd98bd57caf0" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:21 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-915a9185-cca6-4c01-992c-fd98bd57caf0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] Deleting offline snapshot 915a9185-cca6-4c01-992c-fd98bd57caf0 of volume bcdadd83-cac6-48eb-ad10-001567320330 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:40:21 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] snapshot_file for this snap is: volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:40:21 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c21fdbb-3b97-405b-8da7-124e072f9cc5]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:21 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:21 devstack sudo[115213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0
Aug 12 16:40:21 devstack sudo[115213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:22 devstack sudo[115213]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0" returned: 0 in 0.352s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:22 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcdadd83-cac6-48eb-ad10-001567320330(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:40:22 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e061a8-4adc-45bc-b5bb-b6d63738ccb8]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:22 devstack sudo[115218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330
Aug 12 16:40:22 devstack sudo[115218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:22 devstack sudo[115218]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330" returned: 0 in 0.343s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:22 devstack sudo[115224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0
Aug 12 16:40:22 devstack sudo[115224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:22 devstack sudo[115224]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0" returned: 0 in 0.327s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:22 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:22 devstack sudo[115229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0
Aug 12 16:40:22 devstack sudo[115229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:23 devstack sudo[115229]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330.915a9185-cca6-4c01-992c-fd98bd57caf0" returned: 0 in 0.238s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-915a9185-cca6-4c01-992c-fd98bd57caf0" released by "_delete_snapshot" :: held 1.343s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-bcdadd83-cac6-48eb-ad10-001567320330" released by "delete_snapshot" :: held 1.363s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:23 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] Created reservations ['e5303209-a0cd-4558-8db1-d38ea760ecbb', '69c1d07c-2eaa-4066-8a63-14ad65cd1aa4', '1650bbf8-5e2c-45ff-bbe1-9ff3dfad4066', '437ce079-5599-401e-bc8f-61bb78f4a204'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:40:23 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] Delete snapshot completed successfully.
Aug 12 16:40:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-56f607eb-0d25-482c-9e1c-45c546c6bbd9 tempest-ProjectReaderTests-659018349 None] Lock "cinder-915a9185-cca6-4c01-992c-fd98bd57caf0-delete_snapshot" released by "delete_snapshot" :: held 1.489s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-bcdadd83-cac6-48eb-ad10-001567320330-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] Lock "cinder-bcdadd83-cac6-48eb-ad10-001567320330-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-quobyte-bcdadd83-cac6-48eb-ad10-001567320330" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:23 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-bcdadd83-cac6-48eb-ad10-001567320330" acquired by "delete_volume" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:23 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[6069af8f-563e-4675-abe8-939f59115c21]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:23 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:23 devstack sudo[115232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330
Aug 12 16:40:24 devstack sudo[115232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:24 devstack sudo[115232]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330" returned: 0 in 0.354s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:24 devstack sudo[115237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330
Aug 12 16:40:24 devstack sudo[115237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:24 devstack sudo[115237]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-bcdadd83-cac6-48eb-ad10-001567320330" returned: 0 in 0.246s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-bcdadd83-cac6-48eb-ad10-001567320330" released by "delete_volume" :: held 0.661s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:24 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] Created reservations ['e46d36b0-2f37-4af5-8e50-01a423e995c0', '866e1cd1-25a3-46e2-9399-2dd9fe2c892a', 'b96bad45-99ea-43c4-8beb-88063281d9cb', '85ef7938-588d-4946-8872-df76fdd517f1'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:40:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:40:24 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:40:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:24 devstack sudo[115240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:40:24 devstack sudo[115240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:24 devstack sudo[115240]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:24 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.245s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:24 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:40:24 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] Deleted volume successfully.
Aug 12 16:40:24 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7cb6cf57-63df-480d-9669-c4cb657a1ca7 tempest-ProjectReaderTests-659018349 None] Lock "cinder-bcdadd83-cac6-48eb-ad10-001567320330-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Flow 'volume_create_manager' (6659cce4-00f1-480d-ba2f-32dd3a851dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a25b83-0edd-4735-b6bf-93c9294e94c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a25b83-0edd-4735-b6bf-93c9294e94c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1924839284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af21f20-1791-43b0-b2d5-9ad229414222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78cf0a4e76014a28a6606eccf1c95224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:40:25Z,use_quota=True,user_id='9eb54cbbd2224b3098aa1d37281b2965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c90623-1a4f-41ac-ba34-93aabc7582cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88c90623-1a4f-41ac-ba34-93aabc7582cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e557e5-198e-447c-91e2-c91fdf6df031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e557e5-198e-447c-91e2-c91fdf6df031) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4af21f20-1791-43b0-b2d5-9ad229414222', 'volume_name': 'volume-4af21f20-1791-43b0-b2d5-9ad229414222', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1ba7d9-fe2e-44a3-ae23-eacb56fa219c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac1ba7d9-fe2e-44a3-ae23-eacb56fa219c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60440f63-970f-4252-aa3e-92363e74f742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:25 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Volume 4af21f20-1791-43b0-b2d5-9ad229414222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4af21f20-1791-43b0-b2d5-9ad229414222', 'volume_size': 1}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:40:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1924839284',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af21f20-1791-43b0-b2d5-9ad229414222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78cf0a4e76014a28a6606eccf1c95224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:40:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:40:25Z,use_quota=True,user_id='9eb54cbbd2224b3098aa1d37281b2965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Creating volume 4af21f20-1791-43b0-b2d5-9ad229414222 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:40:25 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:25 devstack sudo[115243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222 1073741824
Aug 12 16:40:25 devstack sudo[115243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:25 devstack sudo[115243]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222 1073741824" returned: 0 in 0.391s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:25 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:25 devstack sudo[115249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222
Aug 12 16:40:25 devstack sudo[115249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:26 devstack sudo[115249]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222" returned: 0 in 0.235s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] <== create_volume: return (664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:40:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60440f63-970f-4252-aa3e-92363e74f742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4af21f20-1791-43b0-b2d5-9ad229414222', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97dfad57-d6bd-4db4-b414-b1b91ce37f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:26 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Volume volume-4af21f20-1791-43b0-b2d5-9ad229414222 (4af21f20-1791-43b0-b2d5-9ad229414222): created successfully
Aug 12 16:40:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97dfad57-d6bd-4db4-b414-b1b91ce37f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:26 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Flow 'volume_create_manager' (6659cce4-00f1-480d-ba2f-32dd3a851dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:40:26 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-47cbb30c-8f51-493a-bab2-2b20481f47be tempest-ProjectReaderTests-659018349 None] Created volume successfully.
Aug 12 16:40:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-55c814e4-3a10-41f9-8040-b47e75a6b785 tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-55c814e4-3a10-41f9-8040-b47e75a6b785 tempest-ProjectReaderTests-659018349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:26 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-55c814e4-3a10-41f9-8040-b47e75a6b785 tempest-ProjectReaderTests-659018349 None] Creating offline snapshot 8e777918-a0fe-4e95-8341-158da5d4f7ac of volume 4af21f20-1791-43b0-b2d5-9ad229414222 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:40:26 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc8045d-df8d-4026-819d-f4eb8f93455b]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-55c814e4-3a10-41f9-8040-b47e75a6b785 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:26 devstack sudo[115252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222
Aug 12 16:40:26 devstack sudo[115252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:26 devstack sudo[115252]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-55c814e4-3a10-41f9-8040-b47e75a6b785 tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222" returned: 0 in 0.348s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:26 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-55c814e4-3a10-41f9-8040-b47e75a6b785 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:26 devstack sudo[115257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac 1G
Aug 12 16:40:26 devstack sudo[115257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:27 devstack sudo[115257]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-55c814e4-3a10-41f9-8040-b47e75a6b785 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac 1G" returned: 0 in 0.379s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-55c814e4-3a10-41f9-8040-b47e75a6b785 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af21f20-1791-43b0-b2d5-9ad229414222 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:27 devstack sudo[115263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af21f20-1791-43b0-b2d5-9ad229414222 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac
Aug 12 16:40:27 devstack sudo[115263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:27 devstack sudo[115263]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-55c814e4-3a10-41f9-8040-b47e75a6b785 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4af21f20-1791-43b0-b2d5-9ad229414222 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac" returned: 0 in 0.285s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:27 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-55c814e4-3a10-41f9-8040-b47e75a6b785 tempest-ProjectReaderTests-659018349 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac is being set with open permissions: ugo+rw
Aug 12 16:40:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-55c814e4-3a10-41f9-8040-b47e75a6b785 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:27 devstack sudo[115269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac
Aug 12 16:40:27 devstack sudo[115269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:27 devstack sudo[115269]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-55c814e4-3a10-41f9-8040-b47e75a6b785 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac" returned: 0 in 0.237s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:27 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-55c814e4-3a10-41f9-8040-b47e75a6b785 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:27 devstack sudo[115272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.info
Aug 12 16:40:27 devstack sudo[115272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:28 devstack sudo[115272]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-55c814e4-3a10-41f9-8040-b47e75a6b785 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.info" returned: 0 in 0.247s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:28 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-55c814e4-3a10-41f9-8040-b47e75a6b785 tempest-ProjectReaderTests-659018349 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.info is being set with open permissions: ugo+rw
Aug 12 16:40:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-55c814e4-3a10-41f9-8040-b47e75a6b785 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:28 devstack sudo[115275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.info
Aug 12 16:40:28 devstack sudo[115275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:28 devstack sudo[115275]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-55c814e4-3a10-41f9-8040-b47e75a6b785 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.info" returned: 0 in 0.234s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-55c814e4-3a10-41f9-8040-b47e75a6b785 tempest-ProjectReaderTests-659018349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.801s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:28 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-55c814e4-3a10-41f9-8040-b47e75a6b785 tempest-ProjectReaderTests-659018349 None] Create snapshot completed successfully
Aug 12 16:40:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-8e777918-a0fe-4e95-8341-158da5d4f7ac-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] Lock "cinder-8e777918-a0fe-4e95-8341-158da5d4f7ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-quobyte-4af21f20-1791-43b0-b2d5-9ad229414222" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-4af21f20-1791-43b0-b2d5-9ad229414222" acquired by "delete_snapshot" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-quobyte-8e777918-a0fe-4e95-8341-158da5d4f7ac" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:28 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-8e777918-a0fe-4e95-8341-158da5d4f7ac" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:28 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] Deleting offline snapshot 8e777918-a0fe-4e95-8341-158da5d4f7ac of volume 4af21f20-1791-43b0-b2d5-9ad229414222 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:40:28 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] snapshot_file for this snap is: volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:40:28 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[3426c185-7e15-478d-83a3-8f90c275cffb]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:28 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:28 devstack sudo[115278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac
Aug 12 16:40:28 devstack sudo[115278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:29 devstack sudo[115278]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac" returned: 0 in 0.347s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:29 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4af21f20-1791-43b0-b2d5-9ad229414222(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:40:29 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2faa2d-c53b-4cd3-a582-110d6e5c20a7]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:29 devstack sudo[115283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222
Aug 12 16:40:29 devstack sudo[115283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:29 devstack sudo[115283]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222" returned: 0 in 0.338s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:29 devstack sudo[115288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac
Aug 12 16:40:29 devstack sudo[115288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:29 devstack sudo[115288]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac" returned: 0 in 0.346s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:29 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:29 devstack sudo[115293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac
Aug 12 16:40:29 devstack sudo[115293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:30 devstack sudo[115293]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222.8e777918-a0fe-4e95-8341-158da5d4f7ac" returned: 0 in 0.239s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-8e777918-a0fe-4e95-8341-158da5d4f7ac" released by "_delete_snapshot" :: held 1.356s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-4af21f20-1791-43b0-b2d5-9ad229414222" released by "delete_snapshot" :: held 1.377s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:30 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] Created reservations ['b154acfc-d32e-4f93-8695-12aac4a1d697', '1248bbc6-f185-4d97-9038-db3eb2aad588', '107c99bd-c346-4766-8e02-d34a3cc2bc5b', '47da86d7-9c96-4390-96d3-fed30a8ebf9b'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:40:30 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] Delete snapshot completed successfully.
Aug 12 16:40:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-7aaeb53a-6c92-46f9-9cb5-e38395cdb900 tempest-ProjectReaderTests-659018349 None] Lock "cinder-8e777918-a0fe-4e95-8341-158da5d4f7ac-delete_snapshot" released by "delete_snapshot" :: held 1.504s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-4af21f20-1791-43b0-b2d5-9ad229414222-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] Lock "cinder-4af21f20-1791-43b0-b2d5-9ad229414222-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-quobyte-4af21f20-1791-43b0-b2d5-9ad229414222" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:30 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-4af21f20-1791-43b0-b2d5-9ad229414222" acquired by "delete_volume" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:30 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e51f398-5339-4e33-aac1-6c1f5adeeed5]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:30 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:31 devstack sudo[115318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222
Aug 12 16:40:31 devstack sudo[115318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:31 devstack sudo[115318]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222" returned: 0 in 0.370s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:31 devstack sudo[115338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222
Aug 12 16:40:31 devstack sudo[115338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:31 devstack sudo[115338]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-4af21f20-1791-43b0-b2d5-9ad229414222" returned: 0 in 0.248s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-4af21f20-1791-43b0-b2d5-9ad229414222" released by "delete_volume" :: held 0.678s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:31 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] Created reservations ['1f2107b2-d0bd-435b-a34c-31c4ac5b6a32', '3c7de46d-e5b6-4567-87d0-e2ff4f6b3e76', 'a5488e8b-a804-497f-8cd7-7aa6333e17c6', '1b56283b-12f6-402d-8203-c0e7179eb227'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:40:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:40:31 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:40:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:31 devstack sudo[115341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:40:31 devstack sudo[115341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:31 devstack sudo[115341]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:31 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.240s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:31 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:40:31 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] Deleted volume successfully.
Aug 12 16:40:31 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-14f9cbac-0068-49e8-90e5-a54f848dbd83 tempest-ProjectReaderTests-659018349 None] Lock "cinder-4af21f20-1791-43b0-b2d5-9ad229414222-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Flow 'volume_create_manager' (0dc9ae5a-2d4a-4dd7-bece-4fc213238f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eccd8f4-0c46-4f8e-8e21-12128f1bdd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eccd8f4-0c46-4f8e-8e21-12128f1bdd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-423422696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2333c0b-8888-4ab4-83b9-8b0e8071a180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78cf0a4e76014a28a6606eccf1c95224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:40:32Z,use_quota=True,user_id='9eb54cbbd2224b3098aa1d37281b2965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ba39ab-c5d0-4286-b6c0-69747dc4e688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91ba39ab-c5d0-4286-b6c0-69747dc4e688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3489cace-b6e8-4002-b802-3f3dc893c4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3489cace-b6e8-4002-b802-3f3dc893c4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2333c0b-8888-4ab4-83b9-8b0e8071a180', 'volume_name': 'volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4042a0-b3b9-4cc9-b150-ed3603330490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4042a0-b3b9-4cc9-b150-ed3603330490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fbfaa7-4602-4106-9114-ce0ef74e04d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:32 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Volume e2333c0b-8888-4ab4-83b9-8b0e8071a180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180', 'volume_size': 1}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-423422696',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2333c0b-8888-4ab4-83b9-8b0e8071a180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78cf0a4e76014a28a6606eccf1c95224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:40:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:40:32Z,use_quota=True,user_id='9eb54cbbd2224b3098aa1d37281b2965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Creating volume e2333c0b-8888-4ab4-83b9-8b0e8071a180 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:40:32 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:32 devstack sudo[115344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180 1073741824
Aug 12 16:40:32 devstack sudo[115344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:32 devstack sudo[115344]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180 1073741824" returned: 0 in 0.403s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:32 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:32 devstack sudo[115350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180
Aug 12 16:40:32 devstack sudo[115350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:33 devstack sudo[115350]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180" returned: 0 in 0.244s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:40:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fbfaa7-4602-4106-9114-ce0ef74e04d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301de92b-6658-43dc-83ee-ad14ded87ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:33 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Volume volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180 (e2333c0b-8888-4ab4-83b9-8b0e8071a180): created successfully
Aug 12 16:40:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301de92b-6658-43dc-83ee-ad14ded87ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:33 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Flow 'volume_create_manager' (0dc9ae5a-2d4a-4dd7-bece-4fc213238f6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:40:33 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-519ca717-66ff-4662-ad1d-d297b57ce585 tempest-ProjectReaderTests-659018349 None] Created volume successfully.
Aug 12 16:40:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fb1bddd5-758c-4270-a63f-26fe5154f66c tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fb1bddd5-758c-4270-a63f-26fe5154f66c tempest-ProjectReaderTests-659018349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:33 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-fb1bddd5-758c-4270-a63f-26fe5154f66c tempest-ProjectReaderTests-659018349 None] Creating offline snapshot 915d67ff-eb15-4bc9-8eeb-082ade7dd3eb of volume e2333c0b-8888-4ab4-83b9-8b0e8071a180 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:40:33 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d1b8e2-51ea-4dd3-9706-d3ed30e38cee]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fb1bddd5-758c-4270-a63f-26fe5154f66c tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:33 devstack sudo[115353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180
Aug 12 16:40:33 devstack sudo[115353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:33 devstack sudo[115353]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fb1bddd5-758c-4270-a63f-26fe5154f66c tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180" returned: 0 in 0.346s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:33 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fb1bddd5-758c-4270-a63f-26fe5154f66c tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:33 devstack sudo[115361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb 1G
Aug 12 16:40:33 devstack sudo[115361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:34 devstack sudo[115361]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fb1bddd5-758c-4270-a63f-26fe5154f66c tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb 1G" returned: 0 in 0.384s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fb1bddd5-758c-4270-a63f-26fe5154f66c tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:34 devstack sudo[115369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb
Aug 12 16:40:34 devstack sudo[115369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:34 devstack sudo[115369]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fb1bddd5-758c-4270-a63f-26fe5154f66c tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb" returned: 0 in 0.296s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:34 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-fb1bddd5-758c-4270-a63f-26fe5154f66c tempest-ProjectReaderTests-659018349 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb is being set with open permissions: ugo+rw
Aug 12 16:40:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fb1bddd5-758c-4270-a63f-26fe5154f66c tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:34 devstack sudo[115374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb
Aug 12 16:40:34 devstack sudo[115374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:34 devstack sudo[115374]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fb1bddd5-758c-4270-a63f-26fe5154f66c tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb" returned: 0 in 0.241s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:34 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fb1bddd5-758c-4270-a63f-26fe5154f66c tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:34 devstack sudo[115377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.info
Aug 12 16:40:34 devstack sudo[115377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:35 devstack sudo[115377]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fb1bddd5-758c-4270-a63f-26fe5154f66c tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.info" returned: 0 in 0.244s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:35 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-fb1bddd5-758c-4270-a63f-26fe5154f66c tempest-ProjectReaderTests-659018349 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.info is being set with open permissions: ugo+rw
Aug 12 16:40:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fb1bddd5-758c-4270-a63f-26fe5154f66c tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:35 devstack sudo[115380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.info
Aug 12 16:40:35 devstack sudo[115380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:35 devstack sudo[115380]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-fb1bddd5-758c-4270-a63f-26fe5154f66c tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.info" returned: 0 in 0.244s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-fb1bddd5-758c-4270-a63f-26fe5154f66c tempest-ProjectReaderTests-659018349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.831s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:35 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-fb1bddd5-758c-4270-a63f-26fe5154f66c tempest-ProjectReaderTests-659018349 None] Create snapshot completed successfully
Aug 12 16:40:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-915d67ff-eb15-4bc9-8eeb-082ade7dd3eb-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] Lock "cinder-915d67ff-eb15-4bc9-8eeb-082ade7dd3eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-quobyte-e2333c0b-8888-4ab4-83b9-8b0e8071a180" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-e2333c0b-8888-4ab4-83b9-8b0e8071a180" acquired by "delete_snapshot" :: waited 0.024s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-quobyte-915d67ff-eb15-4bc9-8eeb-082ade7dd3eb" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:35 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-915d67ff-eb15-4bc9-8eeb-082ade7dd3eb" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] Deleting offline snapshot 915d67ff-eb15-4bc9-8eeb-082ade7dd3eb of volume e2333c0b-8888-4ab4-83b9-8b0e8071a180 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:40:35 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] snapshot_file for this snap is: volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:40:35 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[1515c6ae-4c78-4e4b-9ed8-7b15edfe7233]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:35 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:35 devstack sudo[115383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb
Aug 12 16:40:35 devstack sudo[115383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:36 devstack sudo[115383]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb" returned: 0 in 0.352s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:36 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:40:36 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7798f4-69fc-45db-8964-2f5b4d86da9e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:36 devstack sudo[115388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180
Aug 12 16:40:36 devstack sudo[115388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:36 devstack sudo[115388]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180" returned: 0 in 0.344s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:36 devstack sudo[115393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb
Aug 12 16:40:36 devstack sudo[115393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:36 devstack sudo[115393]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb" returned: 0 in 0.336s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:36 devstack sudo[115398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb
Aug 12 16:40:36 devstack sudo[115398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:36 devstack sudo[115398]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:36 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180.915d67ff-eb15-4bc9-8eeb-082ade7dd3eb" returned: 0 in 0.241s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-915d67ff-eb15-4bc9-8eeb-082ade7dd3eb" released by "_delete_snapshot" :: held 1.361s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-e2333c0b-8888-4ab4-83b9-8b0e8071a180" released by "delete_snapshot" :: held 1.380s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:37 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] Created reservations ['c7bc9d43-e48b-4558-8fd6-64fd81898355', '68851c76-0808-40b1-a376-90d7b8f8a29d', '6b19260a-879d-4e2c-bb77-25089ac8d7d5', '809df0a7-fb86-4a0f-8348-9441b6fe81df'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:40:37 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] Delete snapshot completed successfully.
Aug 12 16:40:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-e7fa2386-3280-4a44-a7f3-5349e8ce1b29 tempest-ProjectReaderTests-659018349 None] Lock "cinder-915d67ff-eb15-4bc9-8eeb-082ade7dd3eb-delete_snapshot" released by "delete_snapshot" :: held 1.509s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-e2333c0b-8888-4ab4-83b9-8b0e8071a180-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] Lock "cinder-e2333c0b-8888-4ab4-83b9-8b0e8071a180-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-quobyte-e2333c0b-8888-4ab4-83b9-8b0e8071a180" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:37 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-e2333c0b-8888-4ab4-83b9-8b0e8071a180" acquired by "delete_volume" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:37 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[7411429c-19c3-4e96-a3f2-a46c986ca16a]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:37 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:37 devstack sudo[115401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180
Aug 12 16:40:37 devstack sudo[115401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:38 devstack sudo[115401]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180" returned: 0 in 0.345s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:38 devstack sudo[115407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180
Aug 12 16:40:38 devstack sudo[115407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:38 devstack sudo[115407]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-e2333c0b-8888-4ab4-83b9-8b0e8071a180" returned: 0 in 0.235s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-e2333c0b-8888-4ab4-83b9-8b0e8071a180" released by "delete_volume" :: held 0.634s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:38 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] Created reservations ['1408f316-2cb6-4666-b01f-a46f19ba52e6', '9ca246f4-5433-4006-b7ad-b8cbb137254c', 'f55288ba-daa4-4ebf-a9e5-35a913e9b032', '2cce0fe2-d2e7-416d-ba20-0b0aa8a9abf8'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:40:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:40:38 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:40:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:38 devstack sudo[115410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:40:38 devstack sudo[115410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:38 devstack sudo[115410]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:38 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.241s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:38 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:40:38 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] Deleted volume successfully.
Aug 12 16:40:38 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-63c0c15b-9194-437b-8a4b-8ace3b5a689a tempest-ProjectReaderTests-659018349 None] Lock "cinder-e2333c0b-8888-4ab4-83b9-8b0e8071a180-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Flow 'volume_create_manager' (e15ab41a-790e-4f73-8e1f-fa070bcb1755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f5888d-b44e-4043-a9cb-1263163627a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04f5888d-b44e-4043-a9cb-1263163627a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1383092908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1198528b-a6af-4dcc-bafd-71c3f999b109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78cf0a4e76014a28a6606eccf1c95224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:40:39Z,use_quota=True,user_id='9eb54cbbd2224b3098aa1d37281b2965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8007723d-a9bb-4855-a956-d6774300269b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8007723d-a9bb-4855-a956-d6774300269b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6487836-7857-4163-b60f-e2b2f526ce2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6487836-7857-4163-b60f-e2b2f526ce2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1198528b-a6af-4dcc-bafd-71c3f999b109', 'volume_name': 'volume-1198528b-a6af-4dcc-bafd-71c3f999b109', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91a2dc2-3469-4aa7-9cd7-811fde20d217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e91a2dc2-3469-4aa7-9cd7-811fde20d217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b878f33d-997e-4528-84b4-e0bb0035d235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:39 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Volume 1198528b-a6af-4dcc-bafd-71c3f999b109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1198528b-a6af-4dcc-bafd-71c3f999b109', 'volume_size': 1}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1383092908',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1198528b-a6af-4dcc-bafd-71c3f999b109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78cf0a4e76014a28a6606eccf1c95224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:40:39Z,use_quota=True,user_id='9eb54cbbd2224b3098aa1d37281b2965',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Creating volume 1198528b-a6af-4dcc-bafd-71c3f999b109 {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:40:39 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:39 devstack sudo[115413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109 1073741824
Aug 12 16:40:39 devstack sudo[115413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:39 devstack sudo[115413]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109 1073741824" returned: 0 in 0.407s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:39 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:39 devstack sudo[115418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109
Aug 12 16:40:39 devstack sudo[115418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:40 devstack sudo[115418]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109" returned: 0 in 0.235s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:40:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b878f33d-997e-4528-84b4-e0bb0035d235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1198528b-a6af-4dcc-bafd-71c3f999b109', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc72b0e-3e93-4041-8972-c39bcb90627e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:40:40 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Volume volume-1198528b-a6af-4dcc-bafd-71c3f999b109 (1198528b-a6af-4dcc-bafd-71c3f999b109): created successfully
Aug 12 16:40:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc72b0e-3e93-4041-8972-c39bcb90627e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:40:40 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Flow 'volume_create_manager' (e15ab41a-790e-4f73-8e1f-fa070bcb1755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:40:40 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-a02c64a1-f658-4f09-b475-92f1ba17ff97 tempest-ProjectReaderTests-659018349 None] Created volume successfully.
Aug 12 16:40:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-645f1b65-e665-4324-83b9-43333f8cf2dc tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-645f1b65-e665-4324-83b9-43333f8cf2dc tempest-ProjectReaderTests-659018349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:40 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-645f1b65-e665-4324-83b9-43333f8cf2dc tempest-ProjectReaderTests-659018349 None] Creating offline snapshot 172df013-1577-4e65-84ff-269656374618 of volume 1198528b-a6af-4dcc-bafd-71c3f999b109 {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:40:40 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a2b6fc-1fca-4e2d-a30c-7b141f09c66e]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-645f1b65-e665-4324-83b9-43333f8cf2dc tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:40 devstack sudo[115423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109
Aug 12 16:40:40 devstack sudo[115423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:40 devstack sudo[115423]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-645f1b65-e665-4324-83b9-43333f8cf2dc tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109" returned: 0 in 0.350s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:40 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-645f1b65-e665-4324-83b9-43333f8cf2dc tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:40 devstack sudo[115429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618 1G
Aug 12 16:40:40 devstack sudo[115429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:41 devstack sudo[115429]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-645f1b65-e665-4324-83b9-43333f8cf2dc tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618 1G" returned: 0 in 0.390s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-645f1b65-e665-4324-83b9-43333f8cf2dc tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1198528b-a6af-4dcc-bafd-71c3f999b109 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:41 devstack sudo[115435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1198528b-a6af-4dcc-bafd-71c3f999b109 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618
Aug 12 16:40:41 devstack sudo[115435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:41 devstack sudo[115435]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-645f1b65-e665-4324-83b9-43333f8cf2dc tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1198528b-a6af-4dcc-bafd-71c3f999b109 -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618" returned: 0 in 0.280s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:41 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-645f1b65-e665-4324-83b9-43333f8cf2dc tempest-ProjectReaderTests-659018349 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618 is being set with open permissions: ugo+rw
Aug 12 16:40:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-645f1b65-e665-4324-83b9-43333f8cf2dc tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:41 devstack sudo[115440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618
Aug 12 16:40:41 devstack sudo[115440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:41 devstack sudo[115440]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-645f1b65-e665-4324-83b9-43333f8cf2dc tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618" returned: 0 in 0.234s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:41 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-645f1b65-e665-4324-83b9-43333f8cf2dc tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:41 devstack sudo[115443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.info
Aug 12 16:40:41 devstack sudo[115443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:42 devstack sudo[115443]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-645f1b65-e665-4324-83b9-43333f8cf2dc tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.info" returned: 0 in 0.243s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:42 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-645f1b65-e665-4324-83b9-43333f8cf2dc tempest-ProjectReaderTests-659018349 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.info is being set with open permissions: ugo+rw
Aug 12 16:40:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-645f1b65-e665-4324-83b9-43333f8cf2dc tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:42 devstack sudo[115446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.info
Aug 12 16:40:42 devstack sudo[115446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:42 devstack sudo[115446]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-645f1b65-e665-4324-83b9-43333f8cf2dc tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.info" returned: 0 in 0.235s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-645f1b65-e665-4324-83b9-43333f8cf2dc tempest-ProjectReaderTests-659018349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.805s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:42 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-645f1b65-e665-4324-83b9-43333f8cf2dc tempest-ProjectReaderTests-659018349 None] Create snapshot completed successfully
Aug 12 16:40:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-172df013-1577-4e65-84ff-269656374618-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] Lock "cinder-172df013-1577-4e65-84ff-269656374618-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-quobyte-1198528b-a6af-4dcc-bafd-71c3f999b109" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-1198528b-a6af-4dcc-bafd-71c3f999b109" acquired by "delete_snapshot" :: waited 0.013s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-quobyte-172df013-1577-4e65-84ff-269656374618" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:42 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-172df013-1577-4e65-84ff-269656374618" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] Deleting offline snapshot 172df013-1577-4e65-84ff-269656374618 of volume 1198528b-a6af-4dcc-bafd-71c3f999b109 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:40:42 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] snapshot_file for this snap is: volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:40:42 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[77379c09-0eba-419c-842d-285e8a7d4127]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:42 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:42 devstack sudo[115449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618
Aug 12 16:40:42 devstack sudo[115449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:43 devstack sudo[115449]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618" returned: 0 in 0.351s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:43 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1198528b-a6af-4dcc-bafd-71c3f999b109(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:40:43 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e6a4aa-5ca3-475b-b373-211575f56054]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:43 devstack sudo[115454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109
Aug 12 16:40:43 devstack sudo[115454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:43 devstack sudo[115454]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109" returned: 0 in 0.345s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:43 devstack sudo[115459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618
Aug 12 16:40:43 devstack sudo[115459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:43 devstack sudo[115459]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618" returned: 0 in 0.337s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:43 devstack sudo[115464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618
Aug 12 16:40:43 devstack sudo[115464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:43 devstack sudo[115464]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:43 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109.172df013-1577-4e65-84ff-269656374618" returned: 0 in 0.241s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-172df013-1577-4e65-84ff-269656374618" released by "_delete_snapshot" :: held 1.360s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-1198528b-a6af-4dcc-bafd-71c3f999b109" released by "delete_snapshot" :: held 1.382s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:44 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] Created reservations ['986a941c-c779-4e6c-b27c-a0058080f397', '55ec87c3-0af4-42ad-a6af-bd8cc05fbd43', '63e3461f-5d60-468d-88d4-e5060d43142b', '42d43009-d382-4ab6-9191-6e461f39915f'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:40:44 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] Delete snapshot completed successfully.
Aug 12 16:40:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-47cd9f96-35bc-4efe-be80-307acd6168bb tempest-ProjectReaderTests-659018349 None] Lock "cinder-172df013-1577-4e65-84ff-269656374618-delete_snapshot" released by "delete_snapshot" :: held 1.503s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-1198528b-a6af-4dcc-bafd-71c3f999b109-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] Lock "cinder-1198528b-a6af-4dcc-bafd-71c3f999b109-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] Acquiring lock "cinder-quobyte-1198528b-a6af-4dcc-bafd-71c3f999b109" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:40:44 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-1198528b-a6af-4dcc-bafd-71c3f999b109" acquired by "delete_volume" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:40:44 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[027343cd-20fe-4654-a540-4fbc6e34cc68]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:40:44 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:44 devstack sudo[115467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109
Aug 12 16:40:44 devstack sudo[115467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:45 devstack sudo[115467]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109" returned: 0 in 0.347s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:45 devstack sudo[115472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109
Aug 12 16:40:45 devstack sudo[115472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:45 devstack sudo[115472]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-1198528b-a6af-4dcc-bafd-71c3f999b109" returned: 0 in 0.238s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] Lock "cinder-quobyte-1198528b-a6af-4dcc-bafd-71c3f999b109" released by "delete_volume" :: held 0.641s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:45 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] Created reservations ['8be00520-bbb4-47c7-9c33-f65e43943bc4', '783bd660-5bf5-4629-9ab4-b231b72b1034', '057ae494-cdba-4572-a1cb-818de54b7358', '47868fea-3b5f-4489-ab1a-4f388a9e84cb'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:40:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:40:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:40:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:40:45 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:40:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:40:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:40:45 devstack sudo[115475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:40:45 devstack sudo[115475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:40:45 devstack sudo[115475]: pam_unix(sudo:session): session closed for user root
Aug 12 16:40:45 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.234s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:40:45 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:40:45 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] Deleted volume successfully.
Aug 12 16:40:45 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-b40c7b2a-96a5-44cb-a36d-8ab625883503 tempest-ProjectReaderTests-659018349 None] Lock "cinder-1198528b-a6af-4dcc-bafd-71c3f999b109-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:40:55 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:UPDATE=104,cinder:DELETE=8,cinder:SELECT=90,cinder:INSERT=29 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:40:58 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=75,cinder:INSERT=30,cinder:UPDATE=108,cinder:DELETE=10 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Flow 'volume_create_manager' (73964e22-10db-4df1-9000-81f72f68f63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cbe532c-c3ed-49f8-ad09-1165ab3e89cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cbe532c-c3ed-49f8-ad09-1165ab3e89cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1288140452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33568eec-97f9-4bb2-838c-0d11a3de2a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c509f78586bc46d5bec634609e1062fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:41:06Z,use_quota=True,user_id='4f1d5deec2d447f288274c4127571694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d27d6208-7f1e-4964-b21e-978020ab111a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d27d6208-7f1e-4964-b21e-978020ab111a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cbec9d-a2d5-445e-924c-ab740a9f8912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89cbec9d-a2d5-445e-924c-ab740a9f8912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33568eec-97f9-4bb2-838c-0d11a3de2a2f', 'volume_name': 'volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3580294-6656-48b9-9538-0dd436159f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3580294-6656-48b9-9538-0dd436159f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa2b93c-ad3c-46b1-b7c1-7ed0c33467f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:41:05 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Volume 33568eec-97f9-4bb2-838c-0d11a3de2a2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f', 'volume_size': 1}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7a5b63fdd8b0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:41:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1288140452',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33568eec-97f9-4bb2-838c-0d11a3de2a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c509f78586bc46d5bec634609e1062fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:41:06Z,use_quota=True,user_id='4f1d5deec2d447f288274c4127571694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)}" {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Creating volume 33568eec-97f9-4bb2-838c-0d11a3de2a2f {{(pid=94457) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:41:05 devstack cinder-volume[94457]: INFO cinder.volume.drivers.remotefs [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] casted to osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96
Aug 12 16:41:05 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f 1073741824 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:05 devstack sudo[115483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f 1073741824
Aug 12 16:41:05 devstack sudo[115483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:06 devstack sudo[115483]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f 1073741824" returned: 0 in 0.413s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:06 devstack sudo[115488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f
Aug 12 16:41:06 devstack sudo[115488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:06 devstack sudo[115488]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f" returned: 0 in 0.243s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:06 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'} {{(pid=94457) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Aug 12 16:41:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:41:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa2b93c-ad3c-46b1-b7c1-7ed0c33467f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f', 'volume_size': 1}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:41:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6661de-350b-41b0-860d-72dc3919402e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:41:06 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Volume volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f (33568eec-97f9-4bb2-838c-0d11a3de2a2f): created successfully
Aug 12 16:41:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da6661de-350b-41b0-860d-72dc3919402e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:41:06 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Flow 'volume_create_manager' (73964e22-10db-4df1-9000-81f72f68f63b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:41:06 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-1346ddb7-eee9-4999-8fb4-07307564ed41 tempest-SnapshotDependencyTests-1674354946 None] Created volume successfully.
Aug 12 16:41:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d87d673c-7ead-4474-9d0e-0ccd4e404a6e tempest-SnapshotDependencyTests-1674354946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:41:06 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d87d673c-7ead-4474-9d0e-0ccd4e404a6e tempest-SnapshotDependencyTests-1674354946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:41:07 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-d87d673c-7ead-4474-9d0e-0ccd4e404a6e tempest-SnapshotDependencyTests-1674354946 None] Creating offline snapshot a58f0262-47e5-4ff3-a496-0743633d2358 of volume 33568eec-97f9-4bb2-838c-0d11a3de2a2f {{(pid=94457) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Aug 12 16:41:07 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dfd291-09b3-4e65-b1d3-fee2e0174010]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:41:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d87d673c-7ead-4474-9d0e-0ccd4e404a6e tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:07 devstack sudo[115491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f
Aug 12 16:41:07 devstack sudo[115491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:07 devstack sudo[115491]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d87d673c-7ead-4474-9d0e-0ccd4e404a6e tempest-SnapshotDependencyTests-1674354946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f" returned: 0 in 0.350s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d87d673c-7ead-4474-9d0e-0ccd4e404a6e tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358 1G {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:07 devstack sudo[115496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358 1G
Aug 12 16:41:07 devstack sudo[115496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:07 devstack sudo[115496]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d87d673c-7ead-4474-9d0e-0ccd4e404a6e tempest-SnapshotDependencyTests-1674354946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358 1G" returned: 0 in 0.384s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:07 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d87d673c-7ead-4474-9d0e-0ccd4e404a6e tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:07 devstack sudo[115502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358
Aug 12 16:41:07 devstack sudo[115502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:08 devstack sudo[115502]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d87d673c-7ead-4474-9d0e-0ccd4e404a6e tempest-SnapshotDependencyTests-1674354946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f -F qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358" returned: 0 in 0.288s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:08 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-d87d673c-7ead-4474-9d0e-0ccd4e404a6e tempest-SnapshotDependencyTests-1674354946 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358 is being set with open permissions: ugo+rw
Aug 12 16:41:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d87d673c-7ead-4474-9d0e-0ccd4e404a6e tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:08 devstack sudo[115507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358
Aug 12 16:41:08 devstack sudo[115507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:08 devstack sudo[115507]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d87d673c-7ead-4474-9d0e-0ccd4e404a6e tempest-SnapshotDependencyTests-1674354946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358" returned: 0 in 0.240s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d87d673c-7ead-4474-9d0e-0ccd4e404a6e tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:08 devstack sudo[115510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.info
Aug 12 16:41:08 devstack sudo[115510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:08 devstack sudo[115510]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d87d673c-7ead-4474-9d0e-0ccd4e404a6e tempest-SnapshotDependencyTests-1674354946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.info" returned: 0 in 0.248s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:08 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-d87d673c-7ead-4474-9d0e-0ccd4e404a6e tempest-SnapshotDependencyTests-1674354946 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.info is being set with open permissions: ugo+rw
Aug 12 16:41:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d87d673c-7ead-4474-9d0e-0ccd4e404a6e tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.info {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:08 devstack sudo[115513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.info
Aug 12 16:41:08 devstack sudo[115513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:08 devstack sudo[115513]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-d87d673c-7ead-4474-9d0e-0ccd4e404a6e tempest-SnapshotDependencyTests-1674354946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.info" returned: 0 in 0.237s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:08 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-d87d673c-7ead-4474-9d0e-0ccd4e404a6e tempest-SnapshotDependencyTests-1674354946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.832s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:41:08 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-d87d673c-7ead-4474-9d0e-0ccd4e404a6e tempest-SnapshotDependencyTests-1674354946 None] Create snapshot completed successfully
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=94457) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Flow 'volume_create_manager' (1879ba72-dbe1-417c-9c6b-c5298a87ccdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9134a9e0-7b9b-4f1e-994b-365f6e20a2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9134a9e0-7b9b-4f1e-994b-365f6e20a2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-08-12T14:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c2ecd8d-b2a0-489c-b952-d6ecec208f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c509f78586bc46d5bec634609e1062fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-12T14:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a58f0262-47e5-4ff3-a496-0743633d2358,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-12T14:41:10Z,use_quota=True,user_id='4f1d5deec2d447f288274c4127571694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(408ac219-6905-4676-808f-25e3ed3e2c0a),volume_type_id=408ac219-6905-4676-808f-25e3ed3e2c0a)' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af5f28f-e5a1-4ab8-8fa7-456eac72d717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1af5f28f-e5a1-4ab8-8fa7-456eac72d717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc6a29d-fab3-4ca7-86aa-ee2ac4806fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc6a29d-fab3-4ca7-86aa-ee2ac4806fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2c2ecd8d-b2a0-489c-b952-d6ecec208f19', 'volume_name': 'volume-2c2ecd8d-b2a0-489c-b952-d6ecec208f19', 'volume_size': 1, 'snapshot_id': 'a58f0262-47e5-4ff3-a496-0743633d2358'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a428eb-691f-4c79-b2ab-014f97e7ea4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a428eb-691f-4c79-b2ab-014f97e7ea4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2fa3a9-0866-4734-9325-eb9c7284a87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:41:09 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Volume 2c2ecd8d-b2a0-489c-b952-d6ecec208f19: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2c2ecd8d-b2a0-489c-b952-d6ecec208f19', 'volume_size': 1, 'snapshot_id': 'a58f0262-47e5-4ff3-a496-0743633d2358'}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Acquiring lock "cinder-quobyte-a58f0262-47e5-4ff3-a496-0743633d2358-2c2ecd8d-b2a0-489c-b952-d6ecec208f19" by "_create_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Lock "cinder-quobyte-a58f0262-47e5-4ff3-a496-0743633d2358-2c2ecd8d-b2a0-489c-b952-d6ecec208f19" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Creating volume 2c2ecd8d-b2a0-489c-b952-d6ecec208f19 from snapshot a58f0262-47e5-4ff3-a496-0743633d2358 {{(pid=94457) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Selected osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96 as target Quobyte volume. {{(pid=94457) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Acquiring lock "cinder-quobyte-2c2ecd8d-b2a0-489c-b952-d6ecec208f19" by "_copy_volume_from_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Lock "cinder-quobyte-2c2ecd8d-b2a0-489c-b952-d6ecec208f19" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] snapshot: a58f0262-47e5-4ff3-a496-0743633d2358, volume: 2c2ecd8d-b2a0-489c-b952-d6ecec208f19,  {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f815bd3-d64a-4f63-9588-12dc810c45a7]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:41:09 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:09 devstack sudo[115516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358
Aug 12 16:41:09 devstack sudo[115516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:10 devstack sudo[115516]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358" returned: 0 in 0.347s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:41:10 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19aaac3-968b-47db-b0c5-9ac2b89fe242]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:41:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:10 devstack sudo[115521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f
Aug 12 16:41:10 devstack sudo[115521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:10 devstack sudo[115521]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f" returned: 0 in 0.344s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}}
Aug 12 16:41:10 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Creating direct copy from snapshot {{(pid=94457) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}}
Aug 12 16:41:10 devstack cinder-volume[94457]: DEBUG cinder.utils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Path /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2c2ecd8d-b2a0-489c-b952-d6ecec208f19 not found in is_blk_device check {{(pid=94457) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Aug 12 16:41:10 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2c2ecd8d-b2a0-489c-b952-d6ecec208f19 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:10 devstack sudo[115527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2c2ecd8d-b2a0-489c-b952-d6ecec208f19
Aug 12 16:41:10 devstack sudo[115527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:14 devstack sudo[115527]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2c2ecd8d-b2a0-489c-b952-d6ecec208f19" returned: 0 in 4.087s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:14 devstack cinder-volume[94457]: DEBUG cinder.image.image_utils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Image conversion details: src /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f, size 1024.00 MB, duration 4.09 sec, destination /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2c2ecd8d-b2a0-489c-b952-d6ecec208f19 {{(pid=94457) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Aug 12 16:41:14 devstack cinder-volume[94457]: INFO cinder.image.image_utils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Converted 1024.00 MB image at 250.45 MB/s
Aug 12 16:41:14 devstack cinder-volume[94457]: WARNING cinder.volume.drivers.remotefs [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2c2ecd8d-b2a0-489c-b952-d6ecec208f19 is being set with open permissions: ugo+rw
Aug 12 16:41:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2c2ecd8d-b2a0-489c-b952-d6ecec208f19 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:14 devstack sudo[115540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2c2ecd8d-b2a0-489c-b952-d6ecec208f19
Aug 12 16:41:14 devstack sudo[115540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:14 devstack sudo[115540]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2c2ecd8d-b2a0-489c-b952-d6ecec208f19" returned: 0 in 0.241s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Lock "cinder-quobyte-2c2ecd8d-b2a0-489c-b952-d6ecec208f19" released by "_copy_volume_from_snapshot" :: held 5.093s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:41:14 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Lock "cinder-quobyte-a58f0262-47e5-4ff3-a496-0743633d2358-2c2ecd8d-b2a0-489c-b952-d6ecec208f19" released by "_create_volume_from_snapshot" :: held 5.153s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:41:14 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.171s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:41:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc2fa3a9-0866-4734-9325-eb9c7284a87d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c2ecd8d-b2a0-489c-b952-d6ecec208f19', 'volume_size': 1, 'snapshot_id': 'a58f0262-47e5-4ff3-a496-0743633d2358'}' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:41:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c240d453-2d7c-4b54-8386-e1d5e2c37584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Aug 12 16:41:14 devstack cinder-volume[94457]: INFO cinder.volume.flows.manager.create_volume [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Volume volume-2c2ecd8d-b2a0-489c-b952-d6ecec208f19 (2c2ecd8d-b2a0-489c-b952-d6ecec208f19): created successfully
Aug 12 16:41:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c240d453-2d7c-4b54-8386-e1d5e2c37584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=94457) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Aug 12 16:41:14 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Flow 'volume_create_manager' (1879ba72-dbe1-417c-9c6b-c5298a87ccdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=94457) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Aug 12 16:41:14 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-2a28168d-e35d-4b11-986c-7d446ec32538 tempest-SnapshotDependencyTests-1674354946 None] Created volume successfully.
Aug 12 16:41:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] Acquiring lock "cinder-a58f0262-47e5-4ff3-a496-0743633d2358-delete_snapshot" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:41:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] Lock "cinder-a58f0262-47e5-4ff3-a496-0743633d2358-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:41:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] Acquiring lock "cinder-quobyte-33568eec-97f9-4bb2-838c-0d11a3de2a2f" by "delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:41:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] Lock "cinder-quobyte-33568eec-97f9-4bb2-838c-0d11a3de2a2f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:41:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] Acquiring lock "cinder-quobyte-a58f0262-47e5-4ff3-a496-0743633d2358" by "_delete_snapshot" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:41:15 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] Lock "cinder-quobyte-a58f0262-47e5-4ff3-a496-0743633d2358" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:41:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] Deleting offline snapshot a58f0262-47e5-4ff3-a496-0743633d2358 of volume 33568eec-97f9-4bb2-838c-0d11a3de2a2f {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Aug 12 16:41:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] snapshot_file for this snap is: volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358 {{(pid=94457) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Aug 12 16:41:15 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[99db4691-2d89-465f-9256-606b429765f4]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:41:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:15 devstack sudo[115543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358
Aug 12 16:41:15 devstack sudo[115543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:15 devstack sudo[115543]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358" returned: 0 in 0.351s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:15 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.remotefs [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=94457) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Aug 12 16:41:15 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c29db41-d723-4070-b97a-0b5b7562a54a]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:41:15 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:15 devstack sudo[115548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f
Aug 12 16:41:15 devstack sudo[115548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:16 devstack sudo[115548]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f" returned: 0 in 0.517s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:16 devstack sudo[115554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358
Aug 12 16:41:16 devstack sudo[115554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:16 devstack sudo[115554]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358" returned: 0 in 0.324s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:16 devstack sudo[115559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358
Aug 12 16:41:16 devstack sudo[115559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:16 devstack sudo[115559]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:16 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f.a58f0262-47e5-4ff3-a496-0743633d2358" returned: 0 in 0.241s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] Lock "cinder-quobyte-a58f0262-47e5-4ff3-a496-0743633d2358" released by "_delete_snapshot" :: held 1.527s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:41:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] Lock "cinder-quobyte-33568eec-97f9-4bb2-838c-0d11a3de2a2f" released by "delete_snapshot" :: held 1.552s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:41:16 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] Created reservations ['fd815718-8ac6-4701-8530-8ea8e9d2e004', '6c25334d-3535-4d49-8d1d-6cc4e8bc546b', '7ea40c08-d443-4c1a-8f38-3c5126d73333', '3cd32a1f-c6b1-4406-977b-1653b5af0a69'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:41:16 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] Delete snapshot completed successfully.
Aug 12 16:41:16 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-4fe24ecf-d5a2-4d21-a70a-7aaf5669647b tempest-SnapshotDependencyTests-1674354946 None] Lock "cinder-a58f0262-47e5-4ff3-a496-0743633d2358-delete_snapshot" released by "delete_snapshot" :: held 1.675s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:41:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] Acquiring lock "cinder-33568eec-97f9-4bb2-838c-0d11a3de2a2f-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:41:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] Lock "cinder-33568eec-97f9-4bb2-838c-0d11a3de2a2f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:41:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] Acquiring lock "cinder-quobyte-33568eec-97f9-4bb2-838c-0d11a3de2a2f" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:41:17 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] Lock "cinder-quobyte-33568eec-97f9-4bb2-838c-0d11a3de2a2f" acquired by "delete_volume" :: waited 0.016s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:41:17 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d2576e-99b1-463a-9388-be0bf514eb61]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:41:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:17 devstack sudo[115562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f
Aug 12 16:41:17 devstack sudo[115562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:17 devstack sudo[115562]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f" returned: 0 in 0.348s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:17 devstack sudo[115567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f
Aug 12 16:41:17 devstack sudo[115567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:17 devstack sudo[115567]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:17 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-33568eec-97f9-4bb2-838c-0d11a3de2a2f" returned: 0 in 0.247s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] Lock "cinder-quobyte-33568eec-97f9-4bb2-838c-0d11a3de2a2f" released by "delete_volume" :: held 0.651s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:41:18 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] Created reservations ['8f909ab2-0c9b-4c87-a2bc-e21e151f015f', 'b4451936-ea13-4932-8703-dcc122d7cc15', '85aa5894-6729-4e08-9c28-8226ebd799fe', '25b8cecc-d262-48e6-8598-ee6d87ac62d5'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:41:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:41:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:41:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:41:18 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:41:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:41:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:18 devstack sudo[115570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:41:18 devstack sudo[115570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:18 devstack sudo[115570]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.236s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:18 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:41:18 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] Deleted volume successfully.
Aug 12 16:41:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-f7388918-55f9-45e9-a0b4-09bd6c64f6d1 tempest-SnapshotDependencyTests-1674354946 None] Lock "cinder-33568eec-97f9-4bb2-838c-0d11a3de2a2f-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:41:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] Acquiring lock "cinder-2c2ecd8d-b2a0-489c-b952-d6ecec208f19-delete_volume" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:41:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] Lock "cinder-2c2ecd8d-b2a0-489c-b952-d6ecec208f19-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:41:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] Acquiring lock "cinder-quobyte-2c2ecd8d-b2a0-489c-b952-d6ecec208f19" by "delete_volume" {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Aug 12 16:41:18 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] Lock "cinder-quobyte-2c2ecd8d-b2a0-489c-b952-d6ecec208f19" acquired by "delete_volume" :: waited 0.015s {{(pid=94457) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Aug 12 16:41:18 devstack cinder-volume[94457]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ed05e5-7bfe-4495-8c89-63e7da235acd]: (4, 'qcow2') {{(pid=96184) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Aug 12 16:41:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2c2ecd8d-b2a0-489c-b952-d6ecec208f19 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:18 devstack sudo[115573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2c2ecd8d-b2a0-489c-b952-d6ecec208f19
Aug 12 16:41:18 devstack sudo[115573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:18 devstack sudo[115573]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2c2ecd8d-b2a0-489c-b952-d6ecec208f19" returned: 0 in 0.352s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:18 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2c2ecd8d-b2a0-489c-b952-d6ecec208f19 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:18 devstack sudo[115578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2c2ecd8d-b2a0-489c-b952-d6ecec208f19
Aug 12 16:41:18 devstack sudo[115578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:19 devstack sudo[115578]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143/volume-2c2ecd8d-b2a0-489c-b952-d6ecec208f19" returned: 0 in 0.244s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] Lock "cinder-quobyte-2c2ecd8d-b2a0-489c-b952-d6ecec208f19" released by "delete_volume" :: held 0.633s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG cinder.quota [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] Created reservations ['58a6c721-acf2-485d-8c87-cd4b40a4c4d6', 'b701ac5a-52ec-4647-bcbc-49e5e3659dcd', '4135c005-9ad9-4750-94ae-d3c0bc1fc5f9', '739b4ea1-74c8-46cc-985a-8635284fdd3a'] {{(pid=94457) reserve /opt/stack/cinder/cinder/quota.py:752}}
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:19 devstack sudo[115581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:41:19 devstack sudo[115581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96': None} {{(pid=94457) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}}
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG cinder.volume.drivers.quobyte [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3e4fd3ab-e5bb-42f0-8f29-0da838a6fd96'] {{(pid=94457) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}}
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.lockutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=94457) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143 {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Aug 12 16:41:19 devstack sudo[115581]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.239s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:41:19 devstack cinder-volume[94457]: INFO cinder.volume.manager [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] Deleted volume successfully.
Aug 12 16:41:19 devstack sudo[115584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143
Aug 12 16:41:19 devstack sudo[115584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG cinder.coordination [None req-156f797f-25d6-49b4-9348-a9a3cc506436 tempest-SnapshotDependencyTests-1674354946 None] Lock "cinder-2c2ecd8d-b2a0-489c-b952-d6ecec208f19-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=94457) __release /opt/stack/cinder/cinder/coordination.py:152}}
Aug 12 16:41:19 devstack sudo[115584]: pam_unix(sudo:session): session closed for user root
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG oslo_concurrency.processutils [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5b2cf6b11d10674662f40e060b866143" returned: 0 in 0.262s {{(pid=94457) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG cinder.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Notifying Schedulers of capabilities ... {{(pid=94457) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG oslo_service.periodic_task [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] Running periodic task VolumeManager._thread_info {{(pid=94457) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread count: 29 {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Aug 12 16:41:19 devstack cinder-volume[94457]: DEBUG cinder.volume.manager [None req-4fd9f58f-10b7-4747-851a-528093f09a73 None None] thread info: [<_MainThread(MainThread, started 134533048283264)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 134532936640512)>, <Thread(Thread-3 (stat_writer), started daemon 134532935852864)>, <Thread(Rabbit-heartbeat, started daemon 134532939701568)>, <Thread(Thread-5 (_runner), started daemon 134532934622080)>, <Thread(Thread-7 (_runner), started daemon 134532934702592)>, <Thread(fd_logger, started daemon 134532935060224)>, <Thread(privsep_reader, started daemon 134532933595520)>, <Thread(tpool_thread_0, started daemon 134532925003456)>, <Thread(tpool_thread_1, started daemon 134532916610752)>, <Thread(tpool_thread_2, started daemon 134532908218048)>, <Thread(tpool_thread_3, started daemon 134532899825344)>, <Thread(tpool_thread_4, started daemon 134532891432640)>, <Thread(tpool_thread_5, started daemon 134532883039936)>, <Thread(tpool_thread_6, started daemon 134532874647232)>, <Thread(tpool_thread_7, started daemon 134532866254528)>, <Thread(tpool_thread_8, started daemon 134532857861824)>, <Thread(tpool_thread_9, started daemon 134532849469120)>, <Thread(tpool_thread_10, started daemon 134532841076416)>, <Thread(tpool_thread_11, started daemon 134532832683712)>, <Thread(tpool_thread_12, started daemon 134532824291008)>, <Thread(tpool_thread_13, started daemon 134532815898304)>, <Thread(tpool_thread_14, started daemon 134532807489216)>, <Thread(tpool_thread_15, started daemon 134532799080128)>, <Thread(tpool_thread_16, started daemon 134532790671040)>, <Thread(tpool_thread_17, started daemon 134532782261952)>, <Thread(tpool_thread_18, started daemon 134532773852864)>, <Thread(tpool_thread_19, started daemon 134532765443776)>, <Thread(Rabbit-heartbeat, started daemon 134532925736384)>] {{(pid=94457) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Aug 12 16:41:29 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:SELECT=26,cinder:UPDATE=30,cinder:INSERT=8,cinder:DELETE=3 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Aug 12 16:41:29 devstack cinder-volume[94457]: DEBUG dbcounter [-] [94457] Writing DB stats cinder:UPDATE=28,cinder:SELECT=23,cinder:DELETE=2,cinder:INSERT=7 {{(pid=94457) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}